-- Logs begin at Tue 2022-06-07 13:36:34 UTC, end at Tue 2022-06-07 15:03:53 UTC. -- Jun 07 14:30:08.451977 dv-cinder-844974-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 07 14:30:08.460101 dv-cinder-844974-1-iscsi devstack@n-api.service[103743]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 07 14:30:08.462149 dv-cinder-844974-1-iscsi devstack@n-api.service[103743]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jun 7 14:30:08 2022] *** Jun 07 14:30:08.462149 dv-cinder-844974-1-iscsi devstack@n-api.service[103743]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 07 14:30:08.462149 dv-cinder-844974-1-iscsi devstack@n-api.service[103743]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 07 14:30:08.462149 dv-cinder-844974-1-iscsi devstack@n-api.service[103743]: nodename: dv-cinder-844974-1-iscsi Jun 07 14:30:08.462149 dv-cinder-844974-1-iscsi devstack@n-api.service[103743]: machine: x86_64 Jun 07 14:30:08.462149 dv-cinder-844974-1-iscsi devstack@n-api.service[103743]: clock source: unix Jun 07 14:30:08.462149 dv-cinder-844974-1-iscsi devstack@n-api.service[103743]: pcre jit disabled Jun 07 14:30:08.462149 dv-cinder-844974-1-iscsi devstack@n-api.service[103743]: detected number of CPU cores: 4 Jun 07 14:30:08.462149 dv-cinder-844974-1-iscsi devstack@n-api.service[103743]: current working directory: / Jun 07 14:30:08.462149 dv-cinder-844974-1-iscsi devstack@n-api.service[103743]: detected binary path: /usr/bin/uwsgi-core Jun 07 14:30:08.462728 dv-cinder-844974-1-iscsi devstack@n-api.service[103743]: your processes number limit is 47680 Jun 07 14:30:08.462728 dv-cinder-844974-1-iscsi devstack@n-api.service[103743]: your memory page size is 4096 bytes Jun 07 14:30:08.462728 dv-cinder-844974-1-iscsi devstack@n-api.service[103743]: detected max file descriptor number: 2048 Jun 07 14:30:08.462728 dv-cinder-844974-1-iscsi devstack@n-api.service[103743]: lock engine: pthread robust mutexes Jun 07 14:30:08.462728 dv-cinder-844974-1-iscsi devstack@n-api.service[103743]: thunder lock: enabled Jun 07 14:30:08.462728 dv-cinder-844974-1-iscsi devstack@n-api.service[103743]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 07 14:30:08.462728 dv-cinder-844974-1-iscsi devstack@n-api.service[103743]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 07 14:30:08.508067 dv-cinder-844974-1-iscsi devstack@n-api.service[103743]: Python main interpreter initialized at 0x5603b4d509c0 Jun 07 14:30:08.508067 dv-cinder-844974-1-iscsi devstack@n-api.service[103743]: python threads support enabled Jun 07 14:30:08.508067 dv-cinder-844974-1-iscsi devstack@n-api.service[103743]: your server socket listen backlog is limited to 100 connections Jun 07 14:30:08.508067 dv-cinder-844974-1-iscsi devstack@n-api.service[103743]: your mercy for graceful operations on workers is 90 seconds Jun 07 14:30:08.508485 dv-cinder-844974-1-iscsi devstack@n-api.service[103743]: mapped 403077 bytes (393 KB) for 2 cores Jun 07 14:30:08.508485 dv-cinder-844974-1-iscsi devstack@n-api.service[103743]: *** Operational MODE: preforking *** Jun 07 14:30:08.508754 dv-cinder-844974-1-iscsi devstack@n-api.service[103743]: *** uWSGI is running in multiple interpreter mode *** Jun 07 14:30:08.508754 dv-cinder-844974-1-iscsi devstack@n-api.service[103743]: spawned uWSGI master process (pid: 103743) Jun 07 14:30:08.508955 dv-cinder-844974-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 07 14:30:08.509516 dv-cinder-844974-1-iscsi devstack@n-api.service[103743]: spawned uWSGI worker 1 (pid: 103744, cores: 1) Jun 07 14:30:08.509861 dv-cinder-844974-1-iscsi devstack@n-api.service[103743]: spawned uWSGI worker 2 (pid: 103745, cores: 1) Jun 07 14:30:08.510024 dv-cinder-844974-1-iscsi devstack@n-api.service[103743]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 07 14:30:09.749142 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 07 14:30:09.750364 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 07 14:30:10.546034 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 07 14:30:10.546034 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: from cryptography.utils import int_from_bytes Jun 07 14:30:10.546362 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 07 14:30:10.546362 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: from cryptography.utils import int_from_bytes Jun 07 14:30:10.560825 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 07 14:30:10.560825 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: from cryptography.utils import int_from_bytes Jun 07 14:30:10.561149 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 07 14:30:10.561149 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: from cryptography.utils import int_from_bytes Jun 07 14:30:13.180298 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 07 14:30:13.180881 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 07 14:30:13.181226 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 07 14:30:13.181312 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 07 14:30:13.181403 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 07 14:30:13.181492 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 07 14:30:13.181579 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 07 14:30:13.181702 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 07 14:30:13.181797 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 07 14:30:13.182530 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 07 14:30:13.182626 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.182922 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.183023 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.183254 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.183339 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.183570 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.183655 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.183890 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.183975 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.184202 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.184286 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.184547 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.184649 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.184879 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.185016 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.185199 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.185300 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.185459 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.185569 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.185774 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.185861 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.186090 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.186176 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844974-1-iscsi {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.186411 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.186510 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844974-1-iscsi {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.186721 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.186819 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.187034 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.187128 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.187352 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.187440 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.187655 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.187747 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.187969 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.188054 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.188275 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.188390 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.188624 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.188804 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.189130 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.189236 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.189448 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.189570 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.189761 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.189855 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.190235 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.190359 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.190442 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.190515 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.190713 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.190813 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.191025 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.191126 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.191349 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.191435 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.191660 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.191744 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.191980 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.192108 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.192288 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.192406 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844974-1-iscsi {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.192710 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.192802 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844974-1-iscsi {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.193025 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.193110 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.193340 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.193431 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.193656 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.193740 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.194050 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.194155 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.194360 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.194454 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.194670 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.194765 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.194992 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.195089 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.195303 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.195400 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.195614 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.195704 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.195934 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.196019 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.196253 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.196338 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.196597 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.196700 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.196900 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.196986 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.197208 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.197306 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.197554 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.197653 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.197869 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.197958 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.198173 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.198258 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.198478 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.198575 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.198728 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.198903 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.199033 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.199161 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.199346 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.199473 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.199664 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.199800 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.199985 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.200124 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.200221 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.200477 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.200588 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.200737 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.200842 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.200994 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.201118 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.201315 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.201427 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.201636 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.201723 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.201946 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.202035 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.202257 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.202344 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.202567 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.202678 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.202879 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.202968 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.203187 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.203283 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.203490 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.203588 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.203796 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.203883 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.204102 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.204190 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.204442 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.204553 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.204750 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.204844 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.205068 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.205155 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.205376 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.205471 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.85 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.205697 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.205784 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.85 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.206003 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.206089 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.85 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.206335 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.85 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.206434 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.206646 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.206734 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.206951 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.207037 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.207267 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.207357 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.207587 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.207673 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.207894 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.208042 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.208201 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.208298 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.208528 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.208618 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.208893 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.209870 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.209978 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.210069 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.210069 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.210223 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.210363 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.210455 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.210544 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.210624 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.210703 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.210787 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.210867 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.211010 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.211109 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.211197 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.211277 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.211355 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.211433 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.211524 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.211730 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.211819 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.212036 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.212124 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.212342 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.212514 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.212671 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.212770 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.212979 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.213071 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.213307 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.213408 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.213613 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.213700 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.213919 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.214007 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.214224 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.214322 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.214527 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.214627 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.214832 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.214925 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.215140 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.215236 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.215446 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.215578 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.215752 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.215839 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.216057 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.216147 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.216362 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.216469 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.216692 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.216859 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.216999 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.217100 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.217303 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.217389 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.217617 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.217703 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.217924 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.218018 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.218230 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.218317 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.218548 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.218646 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.218854 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.218941 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.219160 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.219254 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.219468 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.219554 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.219766 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.219854 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.220074 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.220161 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.220409 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.220499 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.220706 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.220795 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.221016 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.221148 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.221320 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.221418 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.221623 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.221718 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.221927 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.222012 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.222229 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.222329 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.222533 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.222628 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.222835 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.222922 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.223135 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.223231 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.223438 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.223525 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.223740 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.223838 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.224055 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.224150 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.224360 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.224468 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.224981 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.225090 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.225090 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.225259 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.225343 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.225429 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.225595 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:30:13.225684 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.225931 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.226021 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.226268 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.226363 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.226600 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.226694 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.226920 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.227008 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.227241 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.227326 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.227555 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.227647 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.227871 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.227968 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.228189 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.228276 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.228534 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.229141 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.229391 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.229480 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.229708 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.229794 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.230025 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.230121 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.230340 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.230429 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.230664 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.230775 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.230981 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.231077 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.231304 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.231396 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.231623 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.231711 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.231934 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.232032 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.232255 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.232343 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.232595 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.232683 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.232917 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.233022 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.233231 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.233319 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.233558 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.233653 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.233873 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.233973 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.234200 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.234288 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.234525 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.234613 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.234847 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.234937 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.235162 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.235249 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.235473 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.235562 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.235784 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.235873 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.236096 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.236183 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.236431 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.236523 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.236758 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.236848 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.237076 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.237162 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.237389 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.237478 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.237702 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.237794 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.238015 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.238101 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.238323 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.238422 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.238636 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.238724 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.238947 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.239034 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.239260 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.239425 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.239573 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.239671 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.239887 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.239975 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.240211 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.240398 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.240537 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.240684 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.240854 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.240955 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.241170 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.241306 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.241476 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.241564 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.241784 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.241874 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.242090 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.242187 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.242398 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.242486 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.242703 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.242790 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.243015 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.243103 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.243322 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.243417 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.243634 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.243729 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.243962 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.244058 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.244292 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.244977 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.245188 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.245344 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.245500 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.245595 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.245815 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.245903 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.246126 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.246221 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.246439 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.246529 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.246748 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.246834 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.247055 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.247149 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.247369 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.247456 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.247679 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.247775 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.247986 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.248081 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.248309 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.248417 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.248655 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.248743 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.248963 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.249062 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.249277 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.249364 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.249585 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.249672 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.249897 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.249991 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.250210 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.250303 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.250520 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.250616 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.250835 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.250923 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.251148 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.251237 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.251462 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.251604 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.251781 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.251920 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.252097 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.252240 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.252440 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.252592 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.252752 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.252891 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.253060 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.253202 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.253379 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.253513 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.253687 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.253822 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.254001 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.254141 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.254309 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.254451 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.254601 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.254745 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.254909 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.255043 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.255221 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.255364 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.255526 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.255911 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.256086 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.256221 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.256450 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.256600 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.256739 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.256886 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.257031 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.257168 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.257304 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.257450 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.257587 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.257737 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.257910 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.258044 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.258213 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.258345 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.258517 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.258660 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.258821 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.258954 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.259129 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.259264 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.259474 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.259612 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.259784 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.259941 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.260139 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.260274 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.260486 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.260624 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.260802 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.260941 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.261125 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.261266 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.261439 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.261574 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.261753 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.261894 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.262065 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.262209 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.262378 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.262521 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.262690 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.262845 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.262983 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.263119 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.263310 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.263444 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.263621 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.263762 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.263944 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.264090 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.264255 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.264419 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.264598 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.264744 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.264892 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.265030 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.265211 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.265346 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.265518 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.265656 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.265837 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.265971 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.266180 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.266270 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.266504 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.266593 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.266820 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.266917 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.267136 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.267224 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.267448 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.267535 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.267757 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.267842 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.268068 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.268170 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.268420 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.268518 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.268712 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.268800 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.269024 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.269112 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.269343 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.269435 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.269652 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.269738 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.269971 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.270065 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.270278 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.270376 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.270597 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.270686 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.270904 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.271000 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.271222 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.271312 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.271531 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.271672 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.271848 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.271992 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.272166 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.272298 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.272502 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.272647 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.272825 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.272976 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.273116 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.273254 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.273432 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.273571 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.273747 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.273886 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.274056 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.274194 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.274361 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.274498 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.274666 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.274803 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.274975 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.275112 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.275284 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.275430 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.275618 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.275756 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.275926 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.276059 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.276240 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.276424 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.276578 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.276715 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.276851 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.276999 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.277143 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.277288 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.277463 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.277604 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.277768 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.277906 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.278085 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.278187 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.278408 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.278496 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.278728 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.278815 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.279031 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.279130 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.279338 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.279427 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.279659 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.279745 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.279969 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.280065 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.280272 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.280359 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.280604 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.280695 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.280911 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.281012 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.281217 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.281315 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.281526 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.281616 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.281854 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.281952 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.282172 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.282258 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.282480 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.282574 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.282790 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.282886 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.283103 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.283191 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.283414 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.283500 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.283721 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.283816 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.284032 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.284118 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.284343 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.284490 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.284673 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.284771 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.284987 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.285074 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.285296 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.285390 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.285603 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.285689 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.285914 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.286001 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.286226 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.286326 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.286534 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.286621 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.286845 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.286932 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.287154 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.287253 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.287457 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.287545 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.287766 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.287854 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.288072 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.288171 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.288396 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.288667 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.288764 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.288999 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.289289 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.289388 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.289625 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.289719 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.289945 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.290034 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.290264 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.290352 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.290586 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.290680 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.290912 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.291001 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.291760 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.291857 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.292070 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.292172 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.292403 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.292506 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.292716 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.292814 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.293026 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.293124 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.293342 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.293439 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.293650 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.293738 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.293956 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.294053 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.294263 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.294351 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.294571 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.294666 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.294874 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.294962 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.295181 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.295280 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.295485 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.295572 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.295788 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.295876 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.296093 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.296180 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.296416 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.296520 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.296733 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.296820 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.297038 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.297134 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.297351 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.297452 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.297657 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.297751 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.297958 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.298045 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.298264 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.298374 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.298569 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.298658 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.298870 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.298963 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.299182 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.299287 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.299525 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.299614 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.299852 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.299938 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.300192 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.300282 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.300525 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.300617 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.300832 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.300930 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.301157 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.301259 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.301462 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.301551 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.301771 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.301861 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.302075 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.302171 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.302388 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.302480 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.302699 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.302797 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.303005 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.303093 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.303318 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.303405 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.303625 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.303720 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.303936 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.304024 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.304245 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.304332 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.304586 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.304695 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.304883 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.304970 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.305184 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.305279 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.305493 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.305588 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.305799 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.305887 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.306101 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.306188 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.306405 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.306495 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.306711 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.306842 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.307562 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.307650 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.307865 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.307954 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.308177 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.308313 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.308503 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.308594 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.308818 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.308907 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.309120 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.309209 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.309426 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.309521 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.309734 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.309822 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.310043 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.310130 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.310353 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.310449 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.310656 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.310743 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.310972 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.311058 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.311282 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.311378 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.311593 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.311728 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.311900 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.312025 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.312213 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.312318 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.312543 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.312648 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.312851 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.312947 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.313163 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.313260 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.313488 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.313648 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.313797 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.313879 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.314105 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.314223 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.314417 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.314518 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.314720 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.314807 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.315025 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.315120 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.315328 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.315423 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.315632 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.315716 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.315932 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.316026 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.316234 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.316321 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.316563 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.316661 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.316865 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.316952 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.317165 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.317250 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.317468 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.317561 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.317774 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.317867 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.318075 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.318167 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.318381 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.318477 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.318685 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.318771 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.318993 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.319077 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.319300 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.319394 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.319645 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.319739 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.319951 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.320037 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.320264 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.320357 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.320610 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.320705 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.320923 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.321020 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.321237 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.321325 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.321557 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.321642 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.321861 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.321959 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.322179 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.322328 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.322512 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.322647 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.322829 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.322970 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.323185 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.323325 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.323463 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.323601 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.323744 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.323882 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.324038 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.324175 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.324332 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.324453 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.324670 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.324769 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.324985 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.325075 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.325308 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.325402 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.325615 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.325713 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.325925 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.326015 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.326236 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.326326 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.326547 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.326643 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.326854 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.326941 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.327164 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.327251 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.327472 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.327566 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.327783 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.327878 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.328094 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.328182 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.328426 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.328531 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.328741 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.328830 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.329049 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.329137 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.329360 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.329449 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.329670 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.329767 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.329976 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.330070 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.330285 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.330373 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.330594 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.330689 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.330901 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.330996 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.331213 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.331303 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.331518 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.331604 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.331830 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.331918 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.332135 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.332220 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.332471 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.332569 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.332780 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.332890 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.333188 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.333283 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.333496 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.333584 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.333809 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.333903 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.334117 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.334215 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.334428 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.334518 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.334740 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.334840 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.335046 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.335136 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.335359 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.335446 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.335665 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.335765 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.336062 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.336149 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.336401 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.336493 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.336702 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.336839 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.337008 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.337105 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.337313 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.337400 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.337621 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.337711 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.337924 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.338545 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.338764 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.338853 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.339069 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.339158 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.339376 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.339463 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.339688 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.339782 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.340008 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.340095 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.340313 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.340429 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.340672 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.340774 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.341041 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.341129 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.341393 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.341481 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.341702 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.341798 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.342061 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.342149 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.342390 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.342607 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.342705 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.342925 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.343018 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.343252 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.343348 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.343580 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.343675 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.343909 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.344007 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.344219 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.344309 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.344565 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.344655 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.344879 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.344969 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.345199 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.345296 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.345506 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.345595 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.345824 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.345926 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.346144 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.346231 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.346449 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.346536 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.346769 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.346865 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.347092 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.347189 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.347408 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.347496 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.347733 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.347834 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.348106 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.348194 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.348491 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.348595 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.348809 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.348918 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.349113 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.349208 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.349427 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.349516 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.349733 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.349824 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.350040 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.350128 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.350355 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.350449 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.350660 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.350757 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.350969 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.351076 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.351273 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.351366 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.351584 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.351673 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.351888 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.351976 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.352196 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.352292 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.352545 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.352690 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.352852 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.352934 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.353162 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.353261 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.353475 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.353569 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.354344 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.354442 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.354672 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.354770 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.354979 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.355068 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.355304 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.355392 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.355615 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.355711 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.355922 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.356011 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.356228 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.356317 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.356557 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.356662 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.356869 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.356955 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.357177 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.357282 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.357485 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.357575 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.357821 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.357908 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.358131 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.358218 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.358451 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.358540 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.358785 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.358879 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.359115 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.359203 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.359430 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.359534 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.359749 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.359845 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.360074 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.360165 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.360395 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.360489 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.360708 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.360798 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.361022 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.361118 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.361330 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.361419 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.361642 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.361730 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.361947 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.362043 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.362256 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.362344 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.362563 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.362693 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.362869 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.362979 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.363173 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.363315 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.363477 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.363630 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.363771 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.363956 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.364094 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.364231 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.364396 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.364533 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.364709 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.364849 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.365023 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.365168 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.365312 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.365457 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.365637 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.365775 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.365947 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.366080 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.366254 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.366395 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.366587 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.366725 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.366898 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.367035 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.367230 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.367322 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.367546 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.367637 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.367872 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.367960 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.368198 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.368314 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.368579 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.368676 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.368841 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.368930 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.369161 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.369279 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.369506 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.369594 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.369826 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.369914 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.370141 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.370236 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.370455 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.370550 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.370773 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.370861 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.371086 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.371249 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.371399 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.371486 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.371719 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.371933 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.372034 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.372263 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.372351 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.372623 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.372893 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.373025 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.373228 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.373326 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.373544 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.373633 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.373861 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.373958 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.374177 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.374275 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.374491 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.374580 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.374807 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.374895 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.375120 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.375211 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.375435 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.375522 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.375751 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.375854 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.376068 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.376170 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.376417 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.376520 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.376740 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.376896 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.377058 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.377243 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.377357 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.377586 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.377687 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.377908 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.378006 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.378227 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.378314 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.378548 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.378717 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.378867 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.378953 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.379226 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.379310 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.379543 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.379631 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.379854 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.379946 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.380164 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.380248 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.380503 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.380845 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.381081 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.381182 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.381392 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.381486 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.381709 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.381798 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.382021 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.382116 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.382337 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.382437 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.382652 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.382755 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.382970 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.383081 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.383287 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.383391 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.383598 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.383684 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.383913 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.384012 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.384230 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.384329 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.384607 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.384780 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.384951 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.385126 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.385274 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.385466 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.385595 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.385798 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.386126 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.386212 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.386448 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.386535 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.386768 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.386855 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.387100 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.387186 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.387415 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.387513 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.387721 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.387808 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.388036 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.388130 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.388350 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.388465 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.388677 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.388772 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.388987 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.389081 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.389305 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.389391 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.389610 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.389696 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.389923 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.390026 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.390232 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.390318 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.390553 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.390769 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.390861 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.391122 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.391223 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.391444 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.391531 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.391776 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.391994 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.392102 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.392347 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.392498 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.392702 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.392788 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.393035 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.393133 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.393340 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.393429 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.393647 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.393734 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.393978 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.394067 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.394276 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.394364 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.394583 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.394670 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.394890 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.394977 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.395202 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.395287 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.395514 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.395607 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.395822 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.395909 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.396132 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.396224 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.396457 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.396561 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.396774 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.396859 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.397081 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.397165 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.397406 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.397549 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.397695 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.397781 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.398007 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.398093 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.398315 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.398414 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.398624 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.398716 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.398930 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.399052 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.399236 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.399331 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.399548 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.399640 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.399854 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.399943 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.400161 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.400247 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.400994 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.401095 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.401328 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.401414 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.401646 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.401741 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.401959 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.402058 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.402292 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.402378 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.402615 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.402702 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.402926 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.403011 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.403236 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.403370 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.403554 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.403645 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.403869 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.403955 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.404196 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.404300 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.404530 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.404630 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.404846 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.404940 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.405159 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.405257 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.405488 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.405574 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.405806 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.406025 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.406120 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.406363 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.406458 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.406689 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.406776 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.407029 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.407296 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.407391 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.407635 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.407722 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.407959 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.408043 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.408267 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.408361 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.408617 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.408716 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.408931 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.409025 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.409247 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.409334 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.409559 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.409644 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.409872 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.409958 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.410186 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.410273 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.410501 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.410596 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.410814 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.410908 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.411126 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.411212 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.411437 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.411523 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.411752 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.411845 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.412109 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.412567 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.412662 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.412743 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.412821 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.412914 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.412995 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.413081 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.413338 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.413476 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.413657 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.413749 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.413967 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.414061 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.414284 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.414370 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.414602 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.414691 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.414914 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.415001 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.415225 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.415317 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.415536 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.415635 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.415849 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.415935 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.416205 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.416808 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.417051 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.417139 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.417366 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.417452 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.417681 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.417775 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.418003 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.418096 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.418335 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.418422 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.418652 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.418748 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.418963 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.419049 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.419328 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.419414 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.419654 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.419749 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.419979 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.420075 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.420293 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.420398 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.420642 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.420729 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.420962 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.421047 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.421284 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.421369 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.421599 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.421688 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.421926 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.422014 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.422242 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.422328 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.422551 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.422638 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.422860 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.422946 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.423167 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.423266 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.423483 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.423580 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.423801 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.423900 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.424114 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.424210 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.424445 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.424546 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.424752 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.424837 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.425067 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.425163 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.425375 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.425462 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.425680 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.425765 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.425983 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.426069 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.426290 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.426384 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.426596 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.426688 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.426897 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.426984 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.427202 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.427287 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.428066 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.428550 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.428671 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.428763 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.428844 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.428921 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.428921 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.429071 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.429158 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.429237 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.429314 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.429391 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.429467 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.429557 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.429644 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.429722 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.429898 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.429985 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.430203 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.430297 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.430509 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.430594 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.430817 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.430904 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.431127 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.431221 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.431459 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.431548 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.431828 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.431915 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.432170 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.432401 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.432503 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.432835 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.432984 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.433152 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.433550 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.433686 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.433797 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.434123 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.434211 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.434449 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.434721 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.434817 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.435073 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.435292 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.435412 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.435729 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.435910 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.436092 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.436553 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.436652 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.437008 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.437193 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.437333 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.437653 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.437777 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.437979 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.438297 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.438403 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.438638 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.438729 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.438975 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.439064 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.439293 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.439391 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.439636 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.439968 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.440300 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.440658 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.440867 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.441041 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.441208 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.441434 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.441531 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.441865 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.442024 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.442191 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.442535 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.442622 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.442865 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.443183 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.443287 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.443508 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.443783 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.443884 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.444138 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.444236 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.444483 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.444615 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.444811 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.444950 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.445144 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.445292 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.445478 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.445634 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.445797 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.445959 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.446131 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.446299 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.446636 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.447000 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.447323 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.447705 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.448045 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.448456 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.448608 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.448747 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.448981 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.449120 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.449263 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 07 14:30:13.449412 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.449663 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.450031 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.450597 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.451128 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.451632 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:30:13.452026 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 07 14:30:13.508189 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: INFO dbcounter [None req-49055e52-631a-45f7-9a6e-c1479efe190a None None] Registered counter for database nova_api Jun 07 14:30:13.513740 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: INFO dbcounter [None req-497ab3fa-66dd-4e14-8a2a-1b8e3112708c None None] Registered counter for database nova_api Jun 07 14:30:13.529448 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG oslo_db.sqlalchemy.engines [None req-49055e52-631a-45f7-9a6e-c1479efe190a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103745) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 14:30:13.534422 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG oslo_db.sqlalchemy.engines [None req-497ab3fa-66dd-4e14-8a2a-1b8e3112708c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103744) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 14:30:13.536016 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG dbcounter [-] [103745] Writer thread running {{(pid=103745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 14:30:13.541245 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG dbcounter [-] [103744] Writer thread running {{(pid=103744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 14:30:13.594826 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.context [None req-49055e52-631a-45f7-9a6e-c1479efe190a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),dc303ae0-773f-43ce-b623-3e851eed4eb7(cell1) {{(pid=103745) load_cells /opt/stack/nova/nova/context.py:464}} Jun 07 14:30:13.598283 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.context [None req-497ab3fa-66dd-4e14-8a2a-1b8e3112708c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),dc303ae0-773f-43ce-b623-3e851eed4eb7(cell1) {{(pid=103744) load_cells /opt/stack/nova/nova/context.py:464}} Jun 07 14:30:13.599001 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG oslo_concurrency.lockutils [None req-49055e52-631a-45f7-9a6e-c1479efe190a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:30:13.600625 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG oslo_concurrency.lockutils [None req-49055e52-631a-45f7-9a6e-c1479efe190a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:30:13.601421 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG oslo_concurrency.lockutils [None req-49055e52-631a-45f7-9a6e-c1479efe190a None None] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:30:13.602394 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG oslo_concurrency.lockutils [None req-497ab3fa-66dd-4e14-8a2a-1b8e3112708c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:30:13.603526 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG oslo_concurrency.lockutils [None req-49055e52-631a-45f7-9a6e-c1479efe190a None None] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:30:13.604662 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG oslo_concurrency.lockutils [None req-497ab3fa-66dd-4e14-8a2a-1b8e3112708c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:30:13.605992 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG oslo_concurrency.lockutils [None req-497ab3fa-66dd-4e14-8a2a-1b8e3112708c None None] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:30:13.607412 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: INFO dbcounter [None req-49055e52-631a-45f7-9a6e-c1479efe190a None None] Registered counter for database nova_cell0 Jun 07 14:30:13.608781 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG oslo_concurrency.lockutils [None req-497ab3fa-66dd-4e14-8a2a-1b8e3112708c None None] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:30:13.611575 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: INFO dbcounter [None req-497ab3fa-66dd-4e14-8a2a-1b8e3112708c None None] Registered counter for database nova_cell0 Jun 07 14:30:13.613432 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: INFO dbcounter [None req-49055e52-631a-45f7-9a6e-c1479efe190a None None] Registered counter for database nova_cell1 Jun 07 14:30:13.617747 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: INFO dbcounter [None req-497ab3fa-66dd-4e14-8a2a-1b8e3112708c None None] Registered counter for database nova_cell1 Jun 07 14:30:13.622990 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG oslo_db.sqlalchemy.engines [None req-49055e52-631a-45f7-9a6e-c1479efe190a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103745) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 14:30:13.627759 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG oslo_db.sqlalchemy.engines [None req-49055e52-631a-45f7-9a6e-c1479efe190a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103745) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 14:30:13.628645 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG oslo_db.sqlalchemy.engines [None req-497ab3fa-66dd-4e14-8a2a-1b8e3112708c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103744) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 14:30:13.631088 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG oslo_db.sqlalchemy.engines [None req-497ab3fa-66dd-4e14-8a2a-1b8e3112708c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103744) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 14:30:13.633650 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG dbcounter [-] [103745] Writer thread running {{(pid=103745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 14:30:13.633998 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG dbcounter [-] [103745] Writer thread running {{(pid=103745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 14:30:13.635628 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG dbcounter [-] [103744] Writer thread running {{(pid=103744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 14:30:13.785983 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: INFO dbcounter [None req-49055e52-631a-45f7-9a6e-c1479efe190a None None] Registered counter for database nova_cell0 Jun 07 14:30:13.794060 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG dbcounter [-] [103744] Writer thread running {{(pid=103744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 14:30:13.794887 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG oslo_db.sqlalchemy.engines [None req-49055e52-631a-45f7-9a6e-c1479efe190a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103745) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 14:30:13.799356 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG dbcounter [-] [103745] Writer thread running {{(pid=103745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 14:30:13.807087 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: INFO dbcounter [None req-497ab3fa-66dd-4e14-8a2a-1b8e3112708c None None] Registered counter for database nova_cell0 Jun 07 14:30:13.816074 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG oslo_db.sqlalchemy.engines [None req-497ab3fa-66dd-4e14-8a2a-1b8e3112708c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103744) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 14:30:13.821048 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG dbcounter [-] [103744] Writer thread running {{(pid=103744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 14:30:14.321457 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: WARNING keystonemiddleware.auth_token [None req-497ab3fa-66dd-4e14-8a2a-1b8e3112708c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 07 14:30:14.329312 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: WARNING keystonemiddleware.auth_token [None req-497ab3fa-66dd-4e14-8a2a-1b8e3112708c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 07 14:30:14.335311 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: WARNING keystonemiddleware.auth_token [None req-49055e52-631a-45f7-9a6e-c1479efe190a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 07 14:30:14.342574 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: WARNING keystonemiddleware.auth_token [None req-49055e52-631a-45f7-9a6e-c1479efe190a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 07 14:30:14.555421 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: WARNING keystonemiddleware.auth_token [None req-497ab3fa-66dd-4e14-8a2a-1b8e3112708c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 07 14:30:14.561471 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: WARNING keystonemiddleware.auth_token [None req-497ab3fa-66dd-4e14-8a2a-1b8e3112708c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 07 14:30:14.566578 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5603b4d509c0 pid: 103744 (default app) Jun 07 14:30:14.569777 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi [None req-497ab3fa-66dd-4e14-8a2a-1b8e3112708c None None] Calling method '>' {{(pid=103744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:30:14.570964 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: INFO nova.api.openstack.requestlog [None req-497ab3fa-66dd-4e14-8a2a-1b8e3112708c None None] 10.222.0.85 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002855 Jun 07 14:30:14.571377 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: [pid: 103744|app: 0|req: 1/1] 10.222.0.85 () {50 vars in 788 bytes} [Tue Jun 7 14:30:14 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:30:14.577720 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: WARNING keystonemiddleware.auth_token [None req-49055e52-631a-45f7-9a6e-c1479efe190a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 07 14:30:14.583609 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: WARNING keystonemiddleware.auth_token [None req-49055e52-631a-45f7-9a6e-c1479efe190a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 07 14:30:14.589321 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5603b4d509c0 pid: 103745 (default app) Jun 07 14:31:38.265864 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi [None req-497ab3fa-66dd-4e14-8a2a-1b8e3112708c None None] Calling method '>' {{(pid=103744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:31:38.267250 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: INFO nova.api.openstack.requestlog [None req-497ab3fa-66dd-4e14-8a2a-1b8e3112708c None None] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001784 Jun 07 14:31:38.269597 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: [pid: 103744|app: 0|req: 2/2] 10.222.0.85 () {54 vars in 930 bytes} [Tue Jun 7 14:31:38 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:31:38.288700 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG dbcounter [-] [103745] Writing DB stats nova_api:SELECT=3 {{(pid=103745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:31:38.290210 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG dbcounter [-] [103745] Writing DB stats nova_cell1:SELECT=3 {{(pid=103745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:31:38.291155 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG dbcounter [-] [103745] Writing DB stats nova_cell0:SELECT=3 {{(pid=103745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:31:38.292637 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG dbcounter [-] [103745] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:31:38.761920 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi [None req-b93c693b-8de2-447b-ade6-62b6ee046db1 admin admin] Calling method '>' {{(pid=103745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:31:38.793639 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: INFO nova.api.openstack.requestlog [None req-b93c693b-8de2-447b-ade6-62b6ee046db1 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.514981 Jun 07 14:31:38.802476 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: [pid: 103745|app: 0|req: 1/3] 10.222.0.85 () {60 vars in 1291 bytes} [Tue Jun 7 14:31:38 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:31:41.185294 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi [None req-497ab3fa-66dd-4e14-8a2a-1b8e3112708c None None] Calling method '>' {{(pid=103744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:31:41.186298 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: INFO nova.api.openstack.requestlog [None req-497ab3fa-66dd-4e14-8a2a-1b8e3112708c None None] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001575 Jun 07 14:31:41.186903 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: [pid: 103744|app: 0|req: 3/4] 10.222.0.85 () {54 vars in 930 bytes} [Tue Jun 7 14:31:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 14:31:41.254680 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi [None req-feba0828-bd27-4589-81fe-455e5dde2052 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "rxtx_factor": 1.0, "id": "c1", "swap": 0, "os-flavor-access:is_public": true, "name": "cirros256", "vcpus": 1, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:31:41.273888 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 07 14:31:41.273888 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: warnings.warn(msg) Jun 07 14:31:41.366573 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: INFO nova.api.openstack.requestlog [None req-feba0828-bd27-4589-81fe-455e5dde2052 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.172999 Jun 07 14:31:41.367799 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: [pid: 103745|app: 0|req: 2/5] 10.222.0.85 () {64 vars in 1282 bytes} [Tue Jun 7 14:31:41 2022] POST /compute/v2.1/flavors => generated 407 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 14:31:41.381330 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG dbcounter [-] [103744] Writing DB stats nova_api:SELECT=3 {{(pid=103744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:31:41.382561 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG dbcounter [-] [103744] Writing DB stats nova_cell0:SELECT=3 {{(pid=103744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:31:41.383690 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG dbcounter [-] [103744] Writing DB stats nova_cell1:SELECT=3 {{(pid=103744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:31:41.384570 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG dbcounter [-] [103744] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:31:41.590963 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi [None req-bcb007e1-ba69-4b8c-ba11-85f3545dad9b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:31:41.593511 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 07 14:31:41.593511 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: warnings.warn(msg) Jun 07 14:31:41.722902 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: INFO nova.api.openstack.requestlog [None req-bcb007e1-ba69-4b8c-ba11-85f3545dad9b admin admin] 10.222.0.85 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.347144 Jun 07 14:31:41.723734 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: [pid: 103744|app: 0|req: 4/6] 10.222.0.85 () {64 vars in 1335 bytes} [Tue Jun 7 14:31:41 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:31:44.064759 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi [None req-feba0828-bd27-4589-81fe-455e5dde2052 admin admin] Calling method '>' {{(pid=103745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:31:44.065890 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: INFO nova.api.openstack.requestlog [None req-feba0828-bd27-4589-81fe-455e5dde2052 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001634 Jun 07 14:31:44.066375 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: [pid: 103745|app: 0|req: 3/7] 10.222.0.85 () {54 vars in 930 bytes} [Tue Jun 7 14:31:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:31:44.175508 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi [None req-2a2800f0-6dd1-435e-89a9-d7e6b3f93eae admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "ram": 512, "swap": 0, "rxtx_factor": 1.0, "id": "d1", "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "os-flavor-access:is_public": true}} {{(pid=103744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:31:44.193524 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 07 14:31:44.193524 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: warnings.warn(msg) Jun 07 14:31:44.264236 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: INFO nova.api.openstack.requestlog [None req-2a2800f0-6dd1-435e-89a9-d7e6b3f93eae admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.191734 Jun 07 14:31:44.264939 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: [pid: 103744|app: 0|req: 5/8] 10.222.0.85 () {64 vars in 1282 bytes} [Tue Jun 7 14:31:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 07 14:31:44.277483 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi [None req-1e7c4132-7911-4a25-83f3-1c24de187f0f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:31:44.278958 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 07 14:31:44.278958 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: warnings.warn(msg) Jun 07 14:31:44.375936 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: INFO nova.api.openstack.requestlog [None req-1e7c4132-7911-4a25-83f3-1c24de187f0f admin admin] 10.222.0.85 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.102623 Jun 07 14:31:44.377386 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: [pid: 103745|app: 0|req: 4/9] 10.222.0.85 () {64 vars in 1335 bytes} [Tue Jun 7 14:31:44 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:31:46.713576 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi [None req-2a2800f0-6dd1-435e-89a9-d7e6b3f93eae admin admin] Calling method '>' {{(pid=103744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:31:46.715112 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: INFO nova.api.openstack.requestlog [None req-2a2800f0-6dd1-435e-89a9-d7e6b3f93eae admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001546 Jun 07 14:31:46.715533 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: [pid: 103744|app: 0|req: 6/10] 10.222.0.85 () {54 vars in 930 bytes} [Tue Jun 7 14:31:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:31:46.780336 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi [None req-07105eb4-e57c-42ce-89fe-1e441006d59b admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 10, "name": "ds1G", "id": "d2", "swap": 0, "ram": 1024, "vcpus": 1}} {{(pid=103745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:31:46.875634 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: INFO nova.api.openstack.requestlog [None req-07105eb4-e57c-42ce-89fe-1e441006d59b admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.153268 Jun 07 14:31:46.876390 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: [pid: 103745|app: 0|req: 5/11] 10.222.0.85 () {64 vars in 1282 bytes} [Tue Jun 7 14:31:46 2022] POST /compute/v2.1/flavors => generated 404 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 14:31:46.888138 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi [None req-aa8e2ef1-158d-4046-8511-4ee683f29773 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:31:47.032195 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: INFO nova.api.openstack.requestlog [None req-aa8e2ef1-158d-4046-8511-4ee683f29773 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.147615 Jun 07 14:31:47.044956 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: [pid: 103744|app: 0|req: 7/12] 10.222.0.85 () {64 vars in 1335 bytes} [Tue Jun 7 14:31:46 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:31:49.380039 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi [None req-07105eb4-e57c-42ce-89fe-1e441006d59b admin admin] Calling method '>' {{(pid=103745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:31:49.381108 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: INFO nova.api.openstack.requestlog [None req-07105eb4-e57c-42ce-89fe-1e441006d59b admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001606 Jun 07 14:31:49.381512 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: [pid: 103745|app: 0|req: 6/13] 10.222.0.85 () {54 vars in 930 bytes} [Tue Jun 7 14:31:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:31:49.445071 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi [None req-808d3c5e-a662-4b90-baf7-a9c443515fad admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "vcpus": 2, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "rxtx_factor": 1.0, "ram": 2048, "name": "ds2G"}} {{(pid=103744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:31:49.520997 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: INFO nova.api.openstack.requestlog [None req-808d3c5e-a662-4b90-baf7-a9c443515fad admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.132292 Jun 07 14:31:49.521547 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: [pid: 103744|app: 0|req: 8/14] 10.222.0.85 () {64 vars in 1282 bytes} [Tue Jun 7 14:31:49 2022] POST /compute/v2.1/flavors => generated 404 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 14:31:49.534219 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi [None req-32737fec-1efe-4856-b3f2-53dfd9a50e2c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:31:49.632760 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: INFO nova.api.openstack.requestlog [None req-32737fec-1efe-4856-b3f2-53dfd9a50e2c admin admin] 10.222.0.85 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.101935 Jun 07 14:31:49.633272 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: [pid: 103745|app: 0|req: 7/15] 10.222.0.85 () {64 vars in 1335 bytes} [Tue Jun 7 14:31:49 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:31:51.994983 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi [None req-808d3c5e-a662-4b90-baf7-a9c443515fad admin admin] Calling method '>' {{(pid=103744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:31:51.996059 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: INFO nova.api.openstack.requestlog [None req-808d3c5e-a662-4b90-baf7-a9c443515fad admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Jun 07 14:31:51.996465 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: [pid: 103744|app: 0|req: 9/16] 10.222.0.85 () {54 vars in 930 bytes} [Tue Jun 7 14:31:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:31:52.058723 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi [None req-4c114347-4f5a-4c74-aba3-2d6b84c1a1c4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 4096, "name": "ds4G", "disk": 20, "id": "d4", "swap": 0, "vcpus": 4, "rxtx_factor": 1.0}} {{(pid=103745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:31:52.143171 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: INFO nova.api.openstack.requestlog [None req-4c114347-4f5a-4c74-aba3-2d6b84c1a1c4 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.140679 Jun 07 14:31:52.143839 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: [pid: 103745|app: 0|req: 8/17] 10.222.0.85 () {64 vars in 1282 bytes} [Tue Jun 7 14:31:52 2022] POST /compute/v2.1/flavors => generated 404 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 14:31:52.156597 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi [None req-2c5bf1a1-7034-4293-948c-a41443131456 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:31:52.243765 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: INFO nova.api.openstack.requestlog [None req-2c5bf1a1-7034-4293-948c-a41443131456 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.090702 Jun 07 14:31:52.245034 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: [pid: 103744|app: 0|req: 10/18] 10.222.0.85 () {64 vars in 1335 bytes} [Tue Jun 7 14:31:52 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:31:54.580204 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi [None req-4c114347-4f5a-4c74-aba3-2d6b84c1a1c4 admin admin] Calling method '>' {{(pid=103745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:31:54.581355 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: INFO nova.api.openstack.requestlog [None req-4c114347-4f5a-4c74-aba3-2d6b84c1a1c4 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001667 Jun 07 14:31:54.581762 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: [pid: 103745|app: 0|req: 9/19] 10.222.0.85 () {54 vars in 930 bytes} [Tue Jun 7 14:31:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 14:31:54.653402 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi [None req-64ae6dfb-6e80-41d9-88d0-86d7244f170f admin admin] Calling method '>' {{(pid=103744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:31:54.678909 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: INFO nova.api.openstack.requestlog [None req-64ae6dfb-6e80-41d9-88d0-86d7244f170f admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.090447 Jun 07 14:31:54.679871 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: [pid: 103744|app: 0|req: 11/20] 10.222.0.85 () {60 vars in 1291 bytes} [Tue Jun 7 14:31:54 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:31:57.059956 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi [None req-4c114347-4f5a-4c74-aba3-2d6b84c1a1c4 admin admin] Calling method '>' {{(pid=103745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:31:57.062597 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: INFO nova.api.openstack.requestlog [None req-4c114347-4f5a-4c74-aba3-2d6b84c1a1c4 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003141 Jun 07 14:31:57.063878 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: [pid: 103745|app: 0|req: 10/21] 10.222.0.85 () {54 vars in 930 bytes} [Tue Jun 7 14:31:57 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:31:57.129498 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi [None req-87e3d9cd-b1da-4b21-ab62-8488a02d5b03 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.tiny", "disk": 1, "os-flavor-access:is_public": true, "vcpus": 1, "id": "1", "rxtx_factor": 1.0, "ram": 512}} {{(pid=103744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:31:57.207897 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: INFO nova.api.openstack.requestlog [None req-87e3d9cd-b1da-4b21-ab62-8488a02d5b03 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.137267 Jun 07 14:31:57.208468 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: [pid: 103744|app: 0|req: 12/22] 10.222.0.85 () {64 vars in 1282 bytes} [Tue Jun 7 14:31:57 2022] POST /compute/v2.1/flavors => generated 402 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 07 14:31:57.223321 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi [None req-6571eaf8-c84f-46e2-8829-bdbbe5e7cf7b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:31:57.318497 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: INFO nova.api.openstack.requestlog [None req-6571eaf8-c84f-46e2-8829-bdbbe5e7cf7b admin admin] 10.222.0.85 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.099078 Jun 07 14:31:57.319114 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: [pid: 103745|app: 0|req: 11/23] 10.222.0.85 () {64 vars in 1332 bytes} [Tue Jun 7 14:31:57 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:31:59.739977 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi [None req-87e3d9cd-b1da-4b21-ab62-8488a02d5b03 admin admin] Calling method '>' {{(pid=103744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:31:59.741084 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: INFO nova.api.openstack.requestlog [None req-87e3d9cd-b1da-4b21-ab62-8488a02d5b03 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001561 Jun 07 14:31:59.741521 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: [pid: 103744|app: 0|req: 13/24] 10.222.0.85 () {54 vars in 930 bytes} [Tue Jun 7 14:31:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:31:59.809321 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi [None req-6d4f0376-7c59-4ad8-ba0e-2f0dd7bee08f admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "ram": 2048, "vcpus": 1, "name": "m1.small", "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20}} {{(pid=103745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:31:59.902746 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: INFO nova.api.openstack.requestlog [None req-6d4f0376-7c59-4ad8-ba0e-2f0dd7bee08f admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.154659 Jun 07 14:31:59.903315 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: [pid: 103745|app: 0|req: 12/25] 10.222.0.85 () {64 vars in 1282 bytes} [Tue Jun 7 14:31:59 2022] POST /compute/v2.1/flavors => generated 405 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 07 14:31:59.915270 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi [None req-21cb8a61-0cb5-4f64-aa2e-cc7f9b4f8b4d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:31:59.996307 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: INFO nova.api.openstack.requestlog [None req-21cb8a61-0cb5-4f64-aa2e-cc7f9b4f8b4d admin admin] 10.222.0.85 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.084533 Jun 07 14:31:59.997058 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: [pid: 103744|app: 0|req: 14/26] 10.222.0.85 () {64 vars in 1332 bytes} [Tue Jun 7 14:31:59 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:32:02.373574 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi [None req-6d4f0376-7c59-4ad8-ba0e-2f0dd7bee08f admin admin] Calling method '>' {{(pid=103745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:32:02.374681 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: INFO nova.api.openstack.requestlog [None req-6d4f0376-7c59-4ad8-ba0e-2f0dd7bee08f admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001579 Jun 07 14:32:02.375083 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: [pid: 103745|app: 0|req: 13/27] 10.222.0.85 () {54 vars in 930 bytes} [Tue Jun 7 14:32:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:32:02.438883 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi [None req-7996c5d3-0099-479b-ac4e-754528c69d70 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 2, "disk": 40, "ram": 4096, "swap": 0, "name": "m1.medium", "rxtx_factor": 1.0}} {{(pid=103744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:32:02.514575 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: INFO nova.api.openstack.requestlog [None req-7996c5d3-0099-479b-ac4e-754528c69d70 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.132972 Jun 07 14:32:02.515134 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: [pid: 103744|app: 0|req: 15/28] 10.222.0.85 () {64 vars in 1282 bytes} [Tue Jun 7 14:32:02 2022] POST /compute/v2.1/flavors => generated 406 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 14:32:02.527839 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi [None req-6e335d01-532a-44d7-8f65-14a07de6a00a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:32:02.695079 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: INFO nova.api.openstack.requestlog [None req-6e335d01-532a-44d7-8f65-14a07de6a00a admin admin] 10.222.0.85 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.171563 Jun 07 14:32:02.695592 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: [pid: 103745|app: 0|req: 14/29] 10.222.0.85 () {64 vars in 1332 bytes} [Tue Jun 7 14:32:02 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:32:05.016983 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi [None req-7996c5d3-0099-479b-ac4e-754528c69d70 admin admin] Calling method '>' {{(pid=103744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:32:05.018170 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: INFO nova.api.openstack.requestlog [None req-7996c5d3-0099-479b-ac4e-754528c69d70 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001611 Jun 07 14:32:05.019053 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: [pid: 103744|app: 0|req: 16/30] 10.222.0.85 () {54 vars in 930 bytes} [Tue Jun 7 14:32:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:32:05.079268 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi [None req-fb182350-4ed0-4b77-83b8-ad448bd0b8ca admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "disk": 80, "ram": 8192, "name": "m1.large", "swap": 0, "rxtx_factor": 1.0}} {{(pid=103745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:32:05.171665 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: INFO nova.api.openstack.requestlog [None req-fb182350-4ed0-4b77-83b8-ad448bd0b8ca admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.146934 Jun 07 14:32:05.172210 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: [pid: 103745|app: 0|req: 15/31] 10.222.0.85 () {64 vars in 1282 bytes} [Tue Jun 7 14:32:05 2022] POST /compute/v2.1/flavors => generated 405 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 14:32:05.183966 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi [None req-cf57802d-c0dd-4ddb-99b4-9b73bf3c5fbe admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:32:05.349839 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: INFO nova.api.openstack.requestlog [None req-cf57802d-c0dd-4ddb-99b4-9b73bf3c5fbe admin admin] 10.222.0.85 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.168514 Jun 07 14:32:05.350175 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: [pid: 103744|app: 0|req: 17/32] 10.222.0.85 () {64 vars in 1332 bytes} [Tue Jun 7 14:32:05 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:32:07.698296 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi [None req-fb182350-4ed0-4b77-83b8-ad448bd0b8ca admin admin] Calling method '>' {{(pid=103745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:32:07.700061 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: INFO nova.api.openstack.requestlog [None req-fb182350-4ed0-4b77-83b8-ad448bd0b8ca admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002892 Jun 07 14:32:07.705808 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: [pid: 103745|app: 0|req: 16/33] 10.222.0.85 () {54 vars in 930 bytes} [Tue Jun 7 14:32:07 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:32:07.766228 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi [None req-70fbc75b-b1c9-4cf2-ab27-299110f8e34d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 160, "vcpus": 8, "ram": 16384, "id": "5"}} {{(pid=103744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:32:07.925866 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: INFO nova.api.openstack.requestlog [None req-70fbc75b-b1c9-4cf2-ab27-299110f8e34d admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.218811 Jun 07 14:32:07.927179 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: [pid: 103744|app: 0|req: 18/34] 10.222.0.85 () {64 vars in 1282 bytes} [Tue Jun 7 14:32:07 2022] POST /compute/v2.1/flavors => generated 408 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 07 14:32:07.938892 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi [None req-6339f7ed-05cd-4dd6-8e23-e32332b117a4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:32:08.054573 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: INFO nova.api.openstack.requestlog [None req-6339f7ed-05cd-4dd6-8e23-e32332b117a4 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.119360 Jun 07 14:32:08.055486 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: [pid: 103745|app: 0|req: 17/35] 10.222.0.85 () {64 vars in 1332 bytes} [Tue Jun 7 14:32:07 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:32:32.982423 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi [None req-70fbc75b-b1c9-4cf2-ab27-299110f8e34d admin admin] Calling method '>' {{(pid=103744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:32:32.983505 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: INFO nova.api.openstack.requestlog [None req-70fbc75b-b1c9-4cf2-ab27-299110f8e34d admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002158 Jun 07 14:32:32.983907 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: [pid: 103744|app: 0|req: 19/36] 10.222.0.85 () {54 vars in 930 bytes} [Tue Jun 7 14:32:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:32:32.994654 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG dbcounter [-] [103745] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:32:33.044604 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi [None req-7184b3c0-f7cc-412d-a19d-8a985868e3d0 admin admin] Calling method '>' {{(pid=103745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:32:33.063055 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: INFO nova.api.openstack.requestlog [None req-7184b3c0-f7cc-412d-a19d-8a985868e3d0 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.072922 Jun 07 14:32:33.063624 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: [pid: 103745|app: 0|req: 18/37] 10.222.0.85 () {60 vars in 1291 bytes} [Tue Jun 7 14:32:32 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:32:34.088099 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi [None req-70fbc75b-b1c9-4cf2-ab27-299110f8e34d admin admin] Calling method '>' {{(pid=103744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:32:34.089864 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: INFO nova.api.openstack.requestlog [None req-70fbc75b-b1c9-4cf2-ab27-299110f8e34d admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002443 Jun 07 14:32:34.091072 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: [pid: 103744|app: 0|req: 20/38] 10.222.0.85 () {56 vars in 1074 bytes} [Tue Jun 7 14:32:34 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:32:34.290715 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi [None req-00b6fff8-a214-4a9f-9413-878307880ddd admin admin] Calling method '>' {{(pid=103745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:32:34.296476 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: INFO nova.api.openstack.wsgi [None req-00b6fff8-a214-4a9f-9413-878307880ddd admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 07 14:32:34.299763 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi [None req-00b6fff8-a214-4a9f-9413-878307880ddd admin admin] Request method failure captured: Jun 07 14:32:34.299763 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 07 14:32:34.299763 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: Accept: application/json Jun 07 14:32:34.299763 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: Accept-Encoding: gzip, deflate Jun 07 14:32:34.299763 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: Connection: keep-alive Jun 07 14:32:34.299763 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: Content-Length: 0 Jun 07 14:32:34.299763 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: Host: 10.222.0.85 Jun 07 14:32:34.299763 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: Openstack-Api-Version: compute 2.90 Jun 07 14:32:34.299763 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: Openstack-System-Scope: None Jun 07 14:32:34.299763 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: User-Agent: python-novaclient Jun 07 14:32:34.299763 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: X-Auth-Token: gAAAAABin2GCnFTQPfAo7kLQVMR01g58b_BXInZX6kih6ojfadX_9VMve9w5KeAGSxMABmFjs3EYYvw3X20Aeh4JOm170lGYW1YzrPapI0yPDmtMWN5vax1Nu0pZf8974-rC7eI8vSmALU_7nibtKYJgpBibfbumNQJdzABs-Y6gLOJbuDx4S-I Jun 07 14:32:34.299763 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: X-Domain-Id: None Jun 07 14:32:34.299763 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: X-Domain-Name: None Jun 07 14:32:34.299763 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: X-Identity-Status: Confirmed Jun 07 14:32:34.299763 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: X-Is-Admin-Project: True Jun 07 14:32:34.299763 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: X-Openstack-Nova-Api-Version: 2.90 Jun 07 14:32:34.299763 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: X-Project-Domain-Id: default Jun 07 14:32:34.299763 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: X-Project-Domain-Name: Default Jun 07 14:32:34.299763 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: X-Project-Id: 61703df7c02543d6ba1f949d9811ee43 Jun 07 14:32:34.299763 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: X-Project-Name: admin Jun 07 14:32:34.299763 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: X-Role: member,admin,reader Jun 07 14:32:34.299763 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: X-Roles: member,admin,reader Jun 07 14:32:34.301679 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/61703df7c02543d6ba1f949d9811ee43"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_61703df7c02543d6ba1f949d9811ee43"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/61703df7c02543d6ba1f949d9811ee43"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/61703df7c02543d6ba1f949d9811ee43"}]}] Jun 07 14:32:34.301679 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: X-Tenant: admin Jun 07 14:32:34.301679 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: X-Tenant-Id: 61703df7c02543d6ba1f949d9811ee43 Jun 07 14:32:34.301679 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: X-Tenant-Name: admin Jun 07 14:32:34.301679 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: X-User: admin Jun 07 14:32:34.301679 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: X-User-Domain-Id: default Jun 07 14:32:34.301679 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: X-User-Domain-Name: Default Jun 07 14:32:34.301679 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: X-User-Id: 3bd6d2364d1d4e71977a1f04d01cd108 Jun 07 14:32:34.301679 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: X-User-Name: admin Jun 07 14:32:34.301679 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: method: > Jun 07 14:32:34.301679 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: exception: Flavor 42 could not be found. Jun 07 14:32:34.301679 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: action_args: {'id': '42'} Jun 07 14:32:34.301679 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: {{(pid=103745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:32:34.301679 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:32:34.302692 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 07 14:32:34.302692 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 07 14:32:34.302692 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 07 14:32:34.302692 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 07 14:32:34.302692 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 07 14:32:34.302692 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 07 14:32:34.302692 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 07 14:32:34.302692 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 07 14:32:34.302692 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 07 14:32:34.302692 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:32:34.302692 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 07 14:32:34.302692 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 07 14:32:34.302692 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 07 14:32:34.302692 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi Jun 07 14:32:34.302692 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:32:34.302692 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi Jun 07 14:32:34.302692 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:32:34.302692 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:32:34.302692 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:32:34.304257 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:32:34.304257 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:32:34.304257 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:32:34.304257 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:32:34.304257 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 07 14:32:34.304257 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:32:34.304257 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 07 14:32:34.304257 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi Jun 07 14:32:34.304257 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:32:34.304257 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi Jun 07 14:32:34.304257 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:32:34.304257 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:32:34.304257 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:32:34.304257 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:32:34.304257 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:32:34.304257 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 07 14:32:34.304257 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi Jun 07 14:32:34.304257 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi [None req-00b6fff8-a214-4a9f-9413-878307880ddd admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:32:34.305704 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: INFO nova.api.openstack.requestlog [None req-00b6fff8-a214-4a9f-9413-878307880ddd admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.066390 Jun 07 14:32:34.305704 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: [pid: 103745|app: 0|req: 19/39] 10.222.0.85 () {60 vars in 1190 bytes} [Tue Jun 7 14:32:34 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 07 14:32:34.311634 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi [None req-edcb8aba-e4ac-4565-bdbb-6faff0b045ef admin admin] Calling method '>' {{(pid=103744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:32:34.314705 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG dbcounter [-] [103744] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:32:34.341736 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: INFO nova.api.openstack.requestlog [None req-edcb8aba-e4ac-4565-bdbb-6faff0b045ef admin admin] 10.222.0.85 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.031556 Jun 07 14:32:34.342323 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: [pid: 103744|app: 0|req: 21/40] 10.222.0.85 () {60 vars in 1210 bytes} [Tue Jun 7 14:32:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:32:34.355486 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi [None req-83e0eee5-e5ca-470e-ba29-d301bab55292 admin admin] Calling method '>' {{(pid=103745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:32:34.377611 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: INFO nova.api.openstack.requestlog [None req-83e0eee5-e5ca-470e-ba29-d301bab55292 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025685 Jun 07 14:32:34.378253 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: [pid: 103745|app: 0|req: 20/41] 10.222.0.85 () {60 vars in 1210 bytes} [Tue Jun 7 14:32:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:32:34.389685 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi [None req-616ee509-999e-4759-aefd-66f46a71f31f admin admin] Calling method '>' {{(pid=103744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:32:34.395762 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: INFO nova.api.openstack.wsgi [None req-616ee509-999e-4759-aefd-66f46a71f31f admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 07 14:32:34.399106 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi [None req-616ee509-999e-4759-aefd-66f46a71f31f admin admin] Request method failure captured: Jun 07 14:32:34.399106 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 07 14:32:34.399106 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: Accept: application/json Jun 07 14:32:34.399106 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: Accept-Encoding: gzip, deflate Jun 07 14:32:34.399106 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: Connection: keep-alive Jun 07 14:32:34.399106 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: Content-Length: 0 Jun 07 14:32:34.399106 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: Host: 10.222.0.85 Jun 07 14:32:34.399106 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: Openstack-Api-Version: compute 2.90 Jun 07 14:32:34.399106 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: Openstack-System-Scope: None Jun 07 14:32:34.399106 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: User-Agent: python-novaclient Jun 07 14:32:34.399106 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: X-Auth-Token: gAAAAABin2GCnFTQPfAo7kLQVMR01g58b_BXInZX6kih6ojfadX_9VMve9w5KeAGSxMABmFjs3EYYvw3X20Aeh4JOm170lGYW1YzrPapI0yPDmtMWN5vax1Nu0pZf8974-rC7eI8vSmALU_7nibtKYJgpBibfbumNQJdzABs-Y6gLOJbuDx4S-I Jun 07 14:32:34.399106 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: X-Domain-Id: None Jun 07 14:32:34.399106 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: X-Domain-Name: None Jun 07 14:32:34.399106 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: X-Identity-Status: Confirmed Jun 07 14:32:34.399106 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: X-Is-Admin-Project: True Jun 07 14:32:34.399106 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: X-Openstack-Nova-Api-Version: 2.90 Jun 07 14:32:34.399106 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: X-Project-Domain-Id: default Jun 07 14:32:34.399106 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: X-Project-Domain-Name: Default Jun 07 14:32:34.399106 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: X-Project-Id: 61703df7c02543d6ba1f949d9811ee43 Jun 07 14:32:34.399106 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: X-Project-Name: admin Jun 07 14:32:34.399106 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: X-Role: member,admin,reader Jun 07 14:32:34.399106 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: X-Roles: member,admin,reader Jun 07 14:32:34.400819 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/61703df7c02543d6ba1f949d9811ee43"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_61703df7c02543d6ba1f949d9811ee43"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/61703df7c02543d6ba1f949d9811ee43"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/61703df7c02543d6ba1f949d9811ee43"}]}] Jun 07 14:32:34.400819 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: X-Tenant: admin Jun 07 14:32:34.400819 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: X-Tenant-Id: 61703df7c02543d6ba1f949d9811ee43 Jun 07 14:32:34.400819 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: X-Tenant-Name: admin Jun 07 14:32:34.400819 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: X-User: admin Jun 07 14:32:34.400819 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: X-User-Domain-Id: default Jun 07 14:32:34.400819 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: X-User-Domain-Name: Default Jun 07 14:32:34.400819 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: X-User-Id: 3bd6d2364d1d4e71977a1f04d01cd108 Jun 07 14:32:34.400819 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: X-User-Name: admin Jun 07 14:32:34.400819 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: method: > Jun 07 14:32:34.400819 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: exception: Flavor 42 could not be found. Jun 07 14:32:34.400819 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: action_args: {'id': '42'} Jun 07 14:32:34.400819 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: {{(pid=103744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:32:34.400819 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:32:34.402044 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 07 14:32:34.402044 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 07 14:32:34.402044 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 07 14:32:34.402044 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 07 14:32:34.402044 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 07 14:32:34.402044 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 07 14:32:34.402044 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 07 14:32:34.402044 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 07 14:32:34.402044 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 07 14:32:34.402044 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:32:34.402044 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 07 14:32:34.402044 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 07 14:32:34.402044 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 07 14:32:34.402044 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi Jun 07 14:32:34.402044 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:32:34.402044 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi Jun 07 14:32:34.402044 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:32:34.402044 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:32:34.402044 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:32:34.403296 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:32:34.403296 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:32:34.403296 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:32:34.403296 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:32:34.403296 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 07 14:32:34.403296 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:32:34.403296 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 07 14:32:34.403296 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi Jun 07 14:32:34.403296 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:32:34.403296 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi Jun 07 14:32:34.403296 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:32:34.403296 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:32:34.403296 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:32:34.403296 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:32:34.403296 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:32:34.403296 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 07 14:32:34.403296 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi Jun 07 14:32:34.403296 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi [None req-616ee509-999e-4759-aefd-66f46a71f31f admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:32:34.404350 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: INFO nova.api.openstack.requestlog [None req-616ee509-999e-4759-aefd-66f46a71f31f admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014992 Jun 07 14:32:34.404350 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: [pid: 103744|app: 0|req: 22/42] 10.222.0.85 () {60 vars in 1190 bytes} [Tue Jun 7 14:32:34 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 07 14:32:35.355238 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi [None req-83e0eee5-e5ca-470e-ba29-d301bab55292 admin admin] Calling method '>' {{(pid=103745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:32:35.356908 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: INFO nova.api.openstack.requestlog [None req-83e0eee5-e5ca-470e-ba29-d301bab55292 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Jun 07 14:32:35.357294 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: [pid: 103745|app: 0|req: 21/43] 10.222.0.85 () {56 vars in 1074 bytes} [Tue Jun 7 14:32:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:32:35.558499 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi [None req-99ccc093-a3d5-4d38-ab71-d855cc8df6b2 admin admin] Calling method '>' {{(pid=103744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:32:35.563964 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: INFO nova.api.openstack.wsgi [None req-99ccc093-a3d5-4d38-ab71-d855cc8df6b2 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 07 14:32:35.565454 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi [None req-99ccc093-a3d5-4d38-ab71-d855cc8df6b2 admin admin] Request method failure captured: Jun 07 14:32:35.565454 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 07 14:32:35.565454 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: Accept: application/json Jun 07 14:32:35.565454 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: Accept-Encoding: gzip, deflate Jun 07 14:32:35.565454 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: Connection: keep-alive Jun 07 14:32:35.565454 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: Content-Length: 0 Jun 07 14:32:35.565454 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: Host: 10.222.0.85 Jun 07 14:32:35.565454 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: Openstack-Api-Version: compute 2.90 Jun 07 14:32:35.565454 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: Openstack-System-Scope: None Jun 07 14:32:35.565454 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: User-Agent: python-novaclient Jun 07 14:32:35.565454 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: X-Auth-Token: gAAAAABin2GDeZswkiZHhS9RWSTw0vNmLAo4lugA2S4upYFwxdO20N2TTx2pP2QSa4YTa0tY-7VP0wRe211KViVOQN-nxdLdiFXFaeqg9QmgMbh0WZ2OIjjyqRGz22nNBbWMYv_R0yyjQ07UQvlwkUfMhsEu11UR9PBmSEzkNwGxn9vmx30xIDc Jun 07 14:32:35.565454 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: X-Domain-Id: None Jun 07 14:32:35.565454 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: X-Domain-Name: None Jun 07 14:32:35.565454 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: X-Identity-Status: Confirmed Jun 07 14:32:35.565454 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: X-Is-Admin-Project: True Jun 07 14:32:35.565454 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: X-Openstack-Nova-Api-Version: 2.90 Jun 07 14:32:35.565454 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: X-Project-Domain-Id: default Jun 07 14:32:35.565454 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: X-Project-Domain-Name: Default Jun 07 14:32:35.565454 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: X-Project-Id: 61703df7c02543d6ba1f949d9811ee43 Jun 07 14:32:35.565454 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: X-Project-Name: admin Jun 07 14:32:35.565454 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: X-Role: member,admin,reader Jun 07 14:32:35.565454 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: X-Roles: member,admin,reader Jun 07 14:32:35.567000 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/61703df7c02543d6ba1f949d9811ee43"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_61703df7c02543d6ba1f949d9811ee43"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/61703df7c02543d6ba1f949d9811ee43"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/61703df7c02543d6ba1f949d9811ee43"}]}] Jun 07 14:32:35.567000 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: X-Tenant: admin Jun 07 14:32:35.567000 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: X-Tenant-Id: 61703df7c02543d6ba1f949d9811ee43 Jun 07 14:32:35.567000 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: X-Tenant-Name: admin Jun 07 14:32:35.567000 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: X-User: admin Jun 07 14:32:35.567000 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: X-User-Domain-Id: default Jun 07 14:32:35.567000 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: X-User-Domain-Name: Default Jun 07 14:32:35.567000 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: X-User-Id: 3bd6d2364d1d4e71977a1f04d01cd108 Jun 07 14:32:35.567000 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: X-User-Name: admin Jun 07 14:32:35.567000 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: method: > Jun 07 14:32:35.567000 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: exception: Flavor 84 could not be found. Jun 07 14:32:35.567000 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: action_args: {'id': '84'} Jun 07 14:32:35.567000 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: {{(pid=103744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:32:35.567000 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:32:35.567906 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 07 14:32:35.567906 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 07 14:32:35.567906 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 07 14:32:35.567906 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 07 14:32:35.567906 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 07 14:32:35.567906 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 07 14:32:35.567906 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 07 14:32:35.567906 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 07 14:32:35.567906 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 07 14:32:35.567906 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:32:35.567906 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 07 14:32:35.567906 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 07 14:32:35.567906 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 07 14:32:35.567906 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi Jun 07 14:32:35.567906 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:32:35.567906 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi Jun 07 14:32:35.567906 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:32:35.567906 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:32:35.567906 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:32:35.572783 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:32:35.572783 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:32:35.572783 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:32:35.572783 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:32:35.572783 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 07 14:32:35.572783 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:32:35.572783 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 07 14:32:35.572783 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi Jun 07 14:32:35.572783 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:32:35.572783 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi Jun 07 14:32:35.572783 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:32:35.572783 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:32:35.572783 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:32:35.572783 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:32:35.572783 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:32:35.572783 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 07 14:32:35.572783 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi Jun 07 14:32:35.572783 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi [None req-99ccc093-a3d5-4d38-ab71-d855cc8df6b2 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:32:35.574091 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: INFO nova.api.openstack.requestlog [None req-99ccc093-a3d5-4d38-ab71-d855cc8df6b2 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.069893 Jun 07 14:32:35.574091 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: [pid: 103744|app: 0|req: 23/44] 10.222.0.85 () {60 vars in 1190 bytes} [Tue Jun 7 14:32:35 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 07 14:32:35.583598 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi [None req-48a59c9c-148a-41af-994b-dc32246f82cd admin admin] Calling method '>' {{(pid=103745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:32:35.598984 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: INFO nova.api.openstack.requestlog [None req-48a59c9c-148a-41af-994b-dc32246f82cd admin admin] 10.222.0.85 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024510 Jun 07 14:32:35.599553 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: [pid: 103745|app: 0|req: 22/45] 10.222.0.85 () {60 vars in 1210 bytes} [Tue Jun 7 14:32:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:32:35.609815 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi [None req-9a85a4e6-8d0d-49dd-9d04-d65500c4ef05 admin admin] Calling method '>' {{(pid=103744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:32:35.624869 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: INFO nova.api.openstack.requestlog [None req-9a85a4e6-8d0d-49dd-9d04-d65500c4ef05 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019032 Jun 07 14:32:35.625422 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: [pid: 103744|app: 0|req: 24/46] 10.222.0.85 () {60 vars in 1210 bytes} [Tue Jun 7 14:32:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:32:35.635758 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi [None req-973e0bce-fa5b-4a14-82bc-38585b86eed7 admin admin] Calling method '>' {{(pid=103745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:32:35.641780 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: INFO nova.api.openstack.wsgi [None req-973e0bce-fa5b-4a14-82bc-38585b86eed7 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 07 14:32:35.643458 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi [None req-973e0bce-fa5b-4a14-82bc-38585b86eed7 admin admin] Request method failure captured: Jun 07 14:32:35.643458 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 07 14:32:35.643458 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: Accept: application/json Jun 07 14:32:35.643458 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: Accept-Encoding: gzip, deflate Jun 07 14:32:35.643458 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: Connection: keep-alive Jun 07 14:32:35.643458 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: Content-Length: 0 Jun 07 14:32:35.643458 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: Host: 10.222.0.85 Jun 07 14:32:35.643458 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: Openstack-Api-Version: compute 2.90 Jun 07 14:32:35.643458 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: Openstack-System-Scope: None Jun 07 14:32:35.643458 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: User-Agent: python-novaclient Jun 07 14:32:35.643458 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: X-Auth-Token: gAAAAABin2GDeZswkiZHhS9RWSTw0vNmLAo4lugA2S4upYFwxdO20N2TTx2pP2QSa4YTa0tY-7VP0wRe211KViVOQN-nxdLdiFXFaeqg9QmgMbh0WZ2OIjjyqRGz22nNBbWMYv_R0yyjQ07UQvlwkUfMhsEu11UR9PBmSEzkNwGxn9vmx30xIDc Jun 07 14:32:35.643458 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: X-Domain-Id: None Jun 07 14:32:35.643458 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: X-Domain-Name: None Jun 07 14:32:35.643458 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: X-Identity-Status: Confirmed Jun 07 14:32:35.643458 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: X-Is-Admin-Project: True Jun 07 14:32:35.643458 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: X-Openstack-Nova-Api-Version: 2.90 Jun 07 14:32:35.643458 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: X-Project-Domain-Id: default Jun 07 14:32:35.643458 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: X-Project-Domain-Name: Default Jun 07 14:32:35.643458 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: X-Project-Id: 61703df7c02543d6ba1f949d9811ee43 Jun 07 14:32:35.643458 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: X-Project-Name: admin Jun 07 14:32:35.643458 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: X-Role: member,admin,reader Jun 07 14:32:35.643458 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: X-Roles: member,admin,reader Jun 07 14:32:35.645050 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/61703df7c02543d6ba1f949d9811ee43"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_61703df7c02543d6ba1f949d9811ee43"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/61703df7c02543d6ba1f949d9811ee43"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/61703df7c02543d6ba1f949d9811ee43"}]}] Jun 07 14:32:35.645050 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: X-Tenant: admin Jun 07 14:32:35.645050 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: X-Tenant-Id: 61703df7c02543d6ba1f949d9811ee43 Jun 07 14:32:35.645050 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: X-Tenant-Name: admin Jun 07 14:32:35.645050 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: X-User: admin Jun 07 14:32:35.645050 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: X-User-Domain-Id: default Jun 07 14:32:35.645050 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: X-User-Domain-Name: Default Jun 07 14:32:35.645050 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: X-User-Id: 3bd6d2364d1d4e71977a1f04d01cd108 Jun 07 14:32:35.645050 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: X-User-Name: admin Jun 07 14:32:35.645050 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: method: > Jun 07 14:32:35.645050 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: exception: Flavor 84 could not be found. Jun 07 14:32:35.645050 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: action_args: {'id': '84'} Jun 07 14:32:35.645050 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: {{(pid=103745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:32:35.645050 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:32:35.646103 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 07 14:32:35.646103 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 07 14:32:35.646103 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 07 14:32:35.646103 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 07 14:32:35.646103 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 07 14:32:35.646103 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 07 14:32:35.646103 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 07 14:32:35.646103 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 07 14:32:35.646103 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 07 14:32:35.646103 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:32:35.646103 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 07 14:32:35.646103 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 07 14:32:35.646103 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 07 14:32:35.646103 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi Jun 07 14:32:35.646103 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:32:35.646103 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi Jun 07 14:32:35.646103 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:32:35.646103 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:32:35.646103 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:32:35.647462 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:32:35.647462 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:32:35.647462 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:32:35.647462 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:32:35.647462 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 07 14:32:35.647462 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:32:35.647462 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 07 14:32:35.647462 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi Jun 07 14:32:35.647462 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:32:35.647462 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi Jun 07 14:32:35.647462 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:32:35.647462 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:32:35.647462 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:32:35.647462 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:32:35.647462 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:32:35.647462 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 07 14:32:35.647462 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi Jun 07 14:32:35.647462 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi [None req-973e0bce-fa5b-4a14-82bc-38585b86eed7 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:32:35.648790 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: INFO nova.api.openstack.requestlog [None req-973e0bce-fa5b-4a14-82bc-38585b86eed7 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012981 Jun 07 14:32:35.648790 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: [pid: 103745|app: 0|req: 23/47] 10.222.0.85 () {60 vars in 1190 bytes} [Tue Jun 7 14:32:35 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 07 14:32:36.529936 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi [None req-9a85a4e6-8d0d-49dd-9d04-d65500c4ef05 admin admin] Calling method '>' {{(pid=103744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:32:36.530978 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: INFO nova.api.openstack.requestlog [None req-9a85a4e6-8d0d-49dd-9d04-d65500c4ef05 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Jun 07 14:32:36.531379 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: [pid: 103744|app: 0|req: 25/48] 10.222.0.85 () {56 vars in 1074 bytes} [Tue Jun 7 14:32:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:32:36.722041 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi [None req-70e5b393-bcb8-4130-937f-ca80373a6c54 admin admin] Calling method '>' {{(pid=103745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:32:36.730276 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: INFO nova.api.openstack.wsgi [None req-70e5b393-bcb8-4130-937f-ca80373a6c54 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 07 14:32:36.731271 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi [None req-70e5b393-bcb8-4130-937f-ca80373a6c54 admin admin] Request method failure captured: Jun 07 14:32:36.731271 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 07 14:32:36.731271 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: Accept: application/json Jun 07 14:32:36.731271 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: Accept-Encoding: gzip, deflate Jun 07 14:32:36.731271 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: Connection: keep-alive Jun 07 14:32:36.731271 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: Content-Length: 0 Jun 07 14:32:36.731271 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: Host: 10.222.0.85 Jun 07 14:32:36.731271 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: Openstack-Api-Version: compute 2.90 Jun 07 14:32:36.731271 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: Openstack-System-Scope: None Jun 07 14:32:36.731271 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: User-Agent: python-novaclient Jun 07 14:32:36.731271 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: X-Auth-Token: gAAAAABin2GECHU9Q8j368ZtW-51qM1_5J4DByHveDmcUDGwtKkbtiU9sBlCX1kwmc55X6lev7BvmxTWMFVhVYNgTmmgn2Cqoprs-TPzO3DsSSQ4-U2fQIARsYGinZHBT0YZ1uU8svoFSKJn5tybtssnB6V5N6pSKV9Nubzg1KKDiQOwCZfoMs4 Jun 07 14:32:36.731271 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: X-Domain-Id: None Jun 07 14:32:36.731271 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: X-Domain-Name: None Jun 07 14:32:36.731271 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: X-Identity-Status: Confirmed Jun 07 14:32:36.731271 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: X-Is-Admin-Project: True Jun 07 14:32:36.731271 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: X-Openstack-Nova-Api-Version: 2.90 Jun 07 14:32:36.731271 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: X-Project-Domain-Id: default Jun 07 14:32:36.731271 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: X-Project-Domain-Name: Default Jun 07 14:32:36.731271 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: X-Project-Id: 61703df7c02543d6ba1f949d9811ee43 Jun 07 14:32:36.731271 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: X-Project-Name: admin Jun 07 14:32:36.731271 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: X-Role: member,admin,reader Jun 07 14:32:36.731271 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: X-Roles: member,admin,reader Jun 07 14:32:36.732931 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/61703df7c02543d6ba1f949d9811ee43"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_61703df7c02543d6ba1f949d9811ee43"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/61703df7c02543d6ba1f949d9811ee43"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/61703df7c02543d6ba1f949d9811ee43"}]}] Jun 07 14:32:36.732931 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: X-Tenant: admin Jun 07 14:32:36.732931 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: X-Tenant-Id: 61703df7c02543d6ba1f949d9811ee43 Jun 07 14:32:36.732931 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: X-Tenant-Name: admin Jun 07 14:32:36.732931 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: X-User: admin Jun 07 14:32:36.732931 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: X-User-Domain-Id: default Jun 07 14:32:36.732931 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: X-User-Domain-Name: Default Jun 07 14:32:36.732931 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: X-User-Id: 3bd6d2364d1d4e71977a1f04d01cd108 Jun 07 14:32:36.732931 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: X-User-Name: admin Jun 07 14:32:36.732931 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: method: > Jun 07 14:32:36.732931 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: exception: Flavor 451 could not be found. Jun 07 14:32:36.732931 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: action_args: {'id': '451'} Jun 07 14:32:36.732931 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: {{(pid=103745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:32:36.732931 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:32:36.735611 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 07 14:32:36.735611 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 07 14:32:36.735611 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 07 14:32:36.735611 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 07 14:32:36.735611 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 07 14:32:36.735611 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 07 14:32:36.735611 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 07 14:32:36.735611 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 07 14:32:36.735611 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 07 14:32:36.735611 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:32:36.735611 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 07 14:32:36.735611 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 07 14:32:36.735611 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 07 14:32:36.735611 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi Jun 07 14:32:36.735611 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:32:36.735611 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi Jun 07 14:32:36.735611 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:32:36.735611 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:32:36.735611 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:32:36.737072 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:32:36.737072 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:32:36.737072 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:32:36.737072 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:32:36.737072 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 07 14:32:36.737072 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:32:36.737072 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 07 14:32:36.737072 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi Jun 07 14:32:36.737072 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:32:36.737072 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi Jun 07 14:32:36.737072 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:32:36.737072 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:32:36.737072 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:32:36.737072 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:32:36.737072 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:32:36.737072 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 07 14:32:36.737072 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: ERROR nova.api.openstack.wsgi Jun 07 14:32:36.737072 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi [None req-70e5b393-bcb8-4130-937f-ca80373a6c54 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:32:36.738296 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: INFO nova.api.openstack.requestlog [None req-70e5b393-bcb8-4130-937f-ca80373a6c54 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.065565 Jun 07 14:32:36.738296 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: [pid: 103745|app: 0|req: 24/49] 10.222.0.85 () {60 vars in 1193 bytes} [Tue Jun 7 14:32:36 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 07 14:32:36.745984 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi [None req-e4c7b002-044c-4fb1-9cf5-6a300117a83f admin admin] Calling method '>' {{(pid=103744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:32:36.766867 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: INFO nova.api.openstack.requestlog [None req-e4c7b002-044c-4fb1-9cf5-6a300117a83f admin admin] 10.222.0.85 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026734 Jun 07 14:32:36.767463 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: [pid: 103744|app: 0|req: 26/50] 10.222.0.85 () {60 vars in 1210 bytes} [Tue Jun 7 14:32:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:32:36.778720 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi [None req-08c0f1ab-024d-448f-b2c2-b11cb5284540 admin admin] Calling method '>' {{(pid=103745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:32:36.792676 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: INFO nova.api.openstack.requestlog [None req-08c0f1ab-024d-448f-b2c2-b11cb5284540 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018046 Jun 07 14:32:36.793242 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: [pid: 103745|app: 0|req: 25/51] 10.222.0.85 () {60 vars in 1210 bytes} [Tue Jun 7 14:32:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:32:36.803409 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi [None req-896b80a6-0c1c-45dc-8f9b-ee721b6190a6 admin admin] Calling method '>' {{(pid=103744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:32:36.809101 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: INFO nova.api.openstack.wsgi [None req-896b80a6-0c1c-45dc-8f9b-ee721b6190a6 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 07 14:32:36.810624 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi [None req-896b80a6-0c1c-45dc-8f9b-ee721b6190a6 admin admin] Request method failure captured: Jun 07 14:32:36.810624 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 07 14:32:36.810624 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: Accept: application/json Jun 07 14:32:36.810624 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: Accept-Encoding: gzip, deflate Jun 07 14:32:36.810624 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: Connection: keep-alive Jun 07 14:32:36.810624 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: Content-Length: 0 Jun 07 14:32:36.810624 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: Host: 10.222.0.85 Jun 07 14:32:36.810624 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: Openstack-Api-Version: compute 2.90 Jun 07 14:32:36.810624 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: Openstack-System-Scope: None Jun 07 14:32:36.810624 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: User-Agent: python-novaclient Jun 07 14:32:36.810624 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: X-Auth-Token: gAAAAABin2GECHU9Q8j368ZtW-51qM1_5J4DByHveDmcUDGwtKkbtiU9sBlCX1kwmc55X6lev7BvmxTWMFVhVYNgTmmgn2Cqoprs-TPzO3DsSSQ4-U2fQIARsYGinZHBT0YZ1uU8svoFSKJn5tybtssnB6V5N6pSKV9Nubzg1KKDiQOwCZfoMs4 Jun 07 14:32:36.810624 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: X-Domain-Id: None Jun 07 14:32:36.810624 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: X-Domain-Name: None Jun 07 14:32:36.810624 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: X-Identity-Status: Confirmed Jun 07 14:32:36.810624 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: X-Is-Admin-Project: True Jun 07 14:32:36.810624 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: X-Openstack-Nova-Api-Version: 2.90 Jun 07 14:32:36.810624 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: X-Project-Domain-Id: default Jun 07 14:32:36.810624 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: X-Project-Domain-Name: Default Jun 07 14:32:36.810624 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: X-Project-Id: 61703df7c02543d6ba1f949d9811ee43 Jun 07 14:32:36.810624 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: X-Project-Name: admin Jun 07 14:32:36.810624 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: X-Role: member,admin,reader Jun 07 14:32:36.810624 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: X-Roles: member,admin,reader Jun 07 14:32:36.812190 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/61703df7c02543d6ba1f949d9811ee43"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_61703df7c02543d6ba1f949d9811ee43"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/61703df7c02543d6ba1f949d9811ee43"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/61703df7c02543d6ba1f949d9811ee43"}]}] Jun 07 14:32:36.812190 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: X-Tenant: admin Jun 07 14:32:36.812190 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: X-Tenant-Id: 61703df7c02543d6ba1f949d9811ee43 Jun 07 14:32:36.812190 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: X-Tenant-Name: admin Jun 07 14:32:36.812190 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: X-User: admin Jun 07 14:32:36.812190 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: X-User-Domain-Id: default Jun 07 14:32:36.812190 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: X-User-Domain-Name: Default Jun 07 14:32:36.812190 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: X-User-Id: 3bd6d2364d1d4e71977a1f04d01cd108 Jun 07 14:32:36.812190 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: X-User-Name: admin Jun 07 14:32:36.812190 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: method: > Jun 07 14:32:36.812190 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: exception: Flavor 451 could not be found. Jun 07 14:32:36.812190 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: action_args: {'id': '451'} Jun 07 14:32:36.812190 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: {{(pid=103744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:32:36.812190 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:32:36.813179 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 07 14:32:36.813179 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 07 14:32:36.813179 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 07 14:32:36.813179 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 07 14:32:36.813179 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 07 14:32:36.813179 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 07 14:32:36.813179 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 07 14:32:36.813179 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 07 14:32:36.813179 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 07 14:32:36.813179 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:32:36.813179 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 07 14:32:36.813179 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 07 14:32:36.813179 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 07 14:32:36.813179 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi Jun 07 14:32:36.813179 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:32:36.813179 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi Jun 07 14:32:36.813179 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:32:36.813179 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:32:36.813179 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:32:36.814466 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:32:36.814466 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:32:36.814466 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:32:36.814466 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:32:36.814466 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 07 14:32:36.814466 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:32:36.814466 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 07 14:32:36.814466 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi Jun 07 14:32:36.814466 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:32:36.814466 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi Jun 07 14:32:36.814466 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:32:36.814466 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:32:36.814466 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:32:36.814466 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:32:36.814466 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:32:36.814466 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 07 14:32:36.814466 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: ERROR nova.api.openstack.wsgi Jun 07 14:32:36.814466 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi [None req-896b80a6-0c1c-45dc-8f9b-ee721b6190a6 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:32:36.815740 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: INFO nova.api.openstack.requestlog [None req-896b80a6-0c1c-45dc-8f9b-ee721b6190a6 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012301 Jun 07 14:32:36.815740 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: [pid: 103744|app: 0|req: 27/52] 10.222.0.85 () {60 vars in 1193 bytes} [Tue Jun 7 14:32:36 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 07 14:32:37.707785 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi [None req-08c0f1ab-024d-448f-b2c2-b11cb5284540 admin admin] Calling method '>' {{(pid=103745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:32:37.708863 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: INFO nova.api.openstack.requestlog [None req-08c0f1ab-024d-448f-b2c2-b11cb5284540 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Jun 07 14:32:37.709260 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: [pid: 103745|app: 0|req: 26/53] 10.222.0.85 () {56 vars in 1074 bytes} [Tue Jun 7 14:32:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:32:37.899232 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi [None req-cf25ad8d-4ad4-48de-8ee9-56d5e4562611 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:32:38.010210 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: INFO nova.api.openstack.requestlog [None req-cf25ad8d-4ad4-48de-8ee9-56d5e4562611 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.162811 Jun 07 14:32:38.010758 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: [pid: 103744|app: 0|req: 28/54] 10.222.0.85 () {64 vars in 1235 bytes} [Tue Jun 7 14:32:37 2022] POST /compute/v2.1/flavors => generated 404 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 14:32:38.880869 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi [None req-08c0f1ab-024d-448f-b2c2-b11cb5284540 admin admin] Calling method '>' {{(pid=103745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:32:38.881977 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: INFO nova.api.openstack.requestlog [None req-08c0f1ab-024d-448f-b2c2-b11cb5284540 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001561 Jun 07 14:32:38.882430 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: [pid: 103745|app: 0|req: 27/55] 10.222.0.85 () {56 vars in 1074 bytes} [Tue Jun 7 14:32:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:32:39.073381 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi [None req-9d96d2fc-f5ea-4fe2-999f-b22181646260 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:32:39.188190 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: INFO nova.api.openstack.requestlog [None req-9d96d2fc-f5ea-4fe2-999f-b22181646260 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.166576 Jun 07 14:32:39.188766 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: [pid: 103744|app: 0|req: 29/56] 10.222.0.85 () {64 vars in 1235 bytes} [Tue Jun 7 14:32:39 2022] POST /compute/v2.1/flavors => generated 405 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 14:32:40.072221 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi [None req-08c0f1ab-024d-448f-b2c2-b11cb5284540 admin admin] Calling method '>' {{(pid=103745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:32:40.073442 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: INFO nova.api.openstack.requestlog [None req-08c0f1ab-024d-448f-b2c2-b11cb5284540 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001692 Jun 07 14:32:40.073973 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: [pid: 103745|app: 0|req: 28/57] 10.222.0.85 () {56 vars in 1074 bytes} [Tue Jun 7 14:32:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:32:40.263330 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi [None req-be8e42f7-673c-4918-a8c3-ca6e6c36d2a7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:32:40.348153 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: INFO nova.api.openstack.requestlog [None req-be8e42f7-673c-4918-a8c3-ca6e6c36d2a7 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.136680 Jun 07 14:32:40.348720 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: [pid: 103744|app: 0|req: 30/58] 10.222.0.85 () {64 vars in 1235 bytes} [Tue Jun 7 14:32:40 2022] POST /compute/v2.1/flavors => generated 407 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 14:32:41.218901 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi [None req-08c0f1ab-024d-448f-b2c2-b11cb5284540 admin admin] Calling method '>' {{(pid=103745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:32:41.219932 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: INFO nova.api.openstack.requestlog [None req-08c0f1ab-024d-448f-b2c2-b11cb5284540 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Jun 07 14:32:41.220324 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: [pid: 103745|app: 0|req: 29/59] 10.222.0.85 () {56 vars in 1074 bytes} [Tue Jun 7 14:32:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:32:41.420487 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi [None req-dd360850-823b-4ac1-8e8e-8e15c545d10c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:32:41.502644 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: INFO nova.api.openstack.requestlog [None req-dd360850-823b-4ac1-8e8e-8e15c545d10c admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.145005 Jun 07 14:32:41.503183 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: [pid: 103744|app: 0|req: 31/60] 10.222.0.85 () {64 vars in 1235 bytes} [Tue Jun 7 14:32:41 2022] POST /compute/v2.1/flavors => generated 409 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 14:32:42.382390 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi [None req-08c0f1ab-024d-448f-b2c2-b11cb5284540 admin admin] Calling method '>' {{(pid=103745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:32:42.383684 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: INFO nova.api.openstack.requestlog [None req-08c0f1ab-024d-448f-b2c2-b11cb5284540 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001688 Jun 07 14:32:42.384079 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: [pid: 103745|app: 0|req: 30/61] 10.222.0.85 () {56 vars in 1074 bytes} [Tue Jun 7 14:32:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:32:42.605345 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi [None req-2dcd65e5-3d2a-458b-9bc8-d2dcdaaf25d9 admin admin] Calling method '>' {{(pid=103744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:32:42.625211 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: INFO nova.api.openstack.requestlog [None req-2dcd65e5-3d2a-458b-9bc8-d2dcdaaf25d9 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.072479 Jun 07 14:32:42.625747 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: [pid: 103744|app: 0|req: 32/62] 10.222.0.85 () {60 vars in 1202 bytes} [Tue Jun 7 14:32:42 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:33:44.486761 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi [None req-08c0f1ab-024d-448f-b2c2-b11cb5284540 admin admin] Calling method '>' {{(pid=103745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:33:44.487772 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: INFO nova.api.openstack.requestlog [None req-08c0f1ab-024d-448f-b2c2-b11cb5284540 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Jun 07 14:33:44.488167 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: [pid: 103745|app: 0|req: 31/63] 10.222.0.85 () {54 vars in 930 bytes} [Tue Jun 7 14:33:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:33:44.495542 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG dbcounter [-] [103744] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:33:44.548466 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi [None req-9c0b776f-7bd7-40bf-9eb4-90dfa64de2d2 admin admin] Calling method '>' {{(pid=103744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:33:44.567564 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: INFO nova.api.openstack.requestlog [None req-9c0b776f-7bd7-40bf-9eb4-90dfa64de2d2 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.073361 Jun 07 14:33:44.568105 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: [pid: 103744|app: 0|req: 33/64] 10.222.0.85 () {60 vars in 1291 bytes} [Tue Jun 7 14:33:44 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:33:44.588556 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG dbcounter [-] [103745] Writing DB stats nova_api:SELECT=14 {{(pid=103745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:33:44.592788 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi [None req-4517d67d-d849-4666-a9ab-d0470b38aa89 admin admin] Calling method '>' {{(pid=103745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:33:44.600298 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: INFO nova.api.openstack.requestlog [None req-4517d67d-d849-4666-a9ab-d0470b38aa89 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013331 Jun 07 14:33:44.600853 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: [pid: 103745|app: 0|req: 32/65] 10.222.0.85 () {60 vars in 1282 bytes} [Tue Jun 7 14:33:44 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:33:44.612943 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi [None req-d4045574-6b69-407c-abb1-0061a333abb6 admin admin] Calling method '>' {{(pid=103744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:33:44.620779 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: INFO nova.api.openstack.requestlog [None req-d4045574-6b69-407c-abb1-0061a333abb6 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011364 Jun 07 14:33:44.621306 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: [pid: 103744|app: 0|req: 34/66] 10.222.0.85 () {60 vars in 1285 bytes} [Tue Jun 7 14:33:44 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:33:44.632925 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi [None req-b6f7d7b4-28dc-44dc-850f-ab32e2e2f9b8 admin admin] Calling method '>' {{(pid=103745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:33:44.640976 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: INFO nova.api.openstack.requestlog [None req-b6f7d7b4-28dc-44dc-850f-ab32e2e2f9b8 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011917 Jun 07 14:33:44.641493 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: [pid: 103745|app: 0|req: 33/67] 10.222.0.85 () {60 vars in 1285 bytes} [Tue Jun 7 14:33:44 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:33:44.652907 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi [None req-f645f8e4-5064-4b9e-bf28-daf7b6eef550 admin admin] Calling method '>' {{(pid=103744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:33:44.661169 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: INFO nova.api.openstack.requestlog [None req-f645f8e4-5064-4b9e-bf28-daf7b6eef550 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011926 Jun 07 14:33:44.661695 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: [pid: 103744|app: 0|req: 35/68] 10.222.0.85 () {60 vars in 1282 bytes} [Tue Jun 7 14:33:44 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:37:10.039283 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi [None req-b6f7d7b4-28dc-44dc-850f-ab32e2e2f9b8 admin admin] Calling method '>' {{(pid=103745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:37:10.040294 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: INFO nova.api.openstack.requestlog [None req-b6f7d7b4-28dc-44dc-850f-ab32e2e2f9b8 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Jun 07 14:37:10.040715 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: [pid: 103745|app: 0|req: 34/69] 10.222.0.85 () {56 vars in 1074 bytes} [Tue Jun 7 14:37:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:37:10.193537 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG dbcounter [-] [103744] Writing DB stats nova_api:SELECT=6 {{(pid=103744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:37:10.311118 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi [None req-7acca923-9566-49fc-b91e-94f4b6e5c933 admin admin] Calling method '>' {{(pid=103744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:37:10.312283 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 07 14:37:10.312283 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: warnings.warn(msg) Jun 07 14:37:10.314349 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG oslo_concurrency.lockutils [None req-7acca923-9566-49fc-b91e-94f4b6e5c933 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:37:10.314976 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG oslo_concurrency.lockutils [None req-7acca923-9566-49fc-b91e-94f4b6e5c933 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:37:10.316199 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG oslo_concurrency.lockutils [None req-7acca923-9566-49fc-b91e-94f4b6e5c933 admin admin] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:37:10.316918 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG oslo_concurrency.lockutils [None req-7acca923-9566-49fc-b91e-94f4b6e5c933 admin admin] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:37:10.354779 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: INFO nova.api.openstack.requestlog [None req-7acca923-9566-49fc-b91e-94f4b6e5c933 admin admin] 10.222.0.85 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.162664 Jun 07 14:37:10.355343 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: [pid: 103744|app: 0|req: 36/70] 10.222.0.85 () {60 vars in 1193 bytes} [Tue Jun 7 14:37:10 2022] GET /compute/v2.1/os-services => generated 791 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 14:37:11.233313 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi [None req-b6f7d7b4-28dc-44dc-850f-ab32e2e2f9b8 admin admin] Calling method '>' {{(pid=103745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:37:11.234324 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: INFO nova.api.openstack.requestlog [None req-b6f7d7b4-28dc-44dc-850f-ab32e2e2f9b8 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Jun 07 14:37:11.234718 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: [pid: 103745|app: 0|req: 35/71] 10.222.0.85 () {56 vars in 1074 bytes} [Tue Jun 7 14:37:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:37:11.424458 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi [None req-638864e8-9e5d-44e2-8928-078a1dd6059e admin admin] Calling method '>' {{(pid=103744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:37:11.425621 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 07 14:37:11.425621 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: warnings.warn(msg) Jun 07 14:37:11.426787 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG oslo_concurrency.lockutils [None req-638864e8-9e5d-44e2-8928-078a1dd6059e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:37:11.427255 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG oslo_concurrency.lockutils [None req-638864e8-9e5d-44e2-8928-078a1dd6059e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:37:11.428050 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG oslo_concurrency.lockutils [None req-638864e8-9e5d-44e2-8928-078a1dd6059e admin admin] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:37:11.428501 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG oslo_concurrency.lockutils [None req-638864e8-9e5d-44e2-8928-078a1dd6059e admin admin] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:37:11.447363 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: INFO nova.api.openstack.requestlog [None req-638864e8-9e5d-44e2-8928-078a1dd6059e admin admin] 10.222.0.85 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.074980 Jun 07 14:37:11.447832 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: [pid: 103744|app: 0|req: 37/72] 10.222.0.85 () {60 vars in 1193 bytes} [Tue Jun 7 14:37:11 2022] GET /compute/v2.1/os-services => generated 791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 14:37:22.750242 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi [None req-b6f7d7b4-28dc-44dc-850f-ab32e2e2f9b8 admin admin] Calling method '>' {{(pid=103745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:37:22.751757 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: INFO nova.api.openstack.requestlog [None req-b6f7d7b4-28dc-44dc-850f-ab32e2e2f9b8 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001930 Jun 07 14:37:22.752154 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: [pid: 103745|app: 0|req: 36/73] 10.222.0.85 () {56 vars in 1074 bytes} [Tue Jun 7 14:37:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:37:22.893676 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG dbcounter [-] [103744] Writing DB stats nova_cell0:SELECT=4 {{(pid=103744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:37:22.894397 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG dbcounter [-] [103744] Writing DB stats nova_cell1:SELECT=4 {{(pid=103744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:37:22.895037 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG dbcounter [-] [103744] Writing DB stats nova_api:SELECT=8 {{(pid=103744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:37:22.942617 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi [None req-4078b969-0d18-4a7f-9327-8929a8db2403 admin admin] Calling method '>' {{(pid=103744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:37:22.943785 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 07 14:37:22.943785 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: warnings.warn(msg) Jun 07 14:37:22.945006 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG oslo_concurrency.lockutils [None req-4078b969-0d18-4a7f-9327-8929a8db2403 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:37:22.945478 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG oslo_concurrency.lockutils [None req-4078b969-0d18-4a7f-9327-8929a8db2403 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:37:22.946269 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG oslo_concurrency.lockutils [None req-4078b969-0d18-4a7f-9327-8929a8db2403 admin admin] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:37:22.946722 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG oslo_concurrency.lockutils [None req-4078b969-0d18-4a7f-9327-8929a8db2403 admin admin] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:37:22.972836 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: INFO nova.api.openstack.requestlog [None req-4078b969-0d18-4a7f-9327-8929a8db2403 admin admin] 10.222.0.85 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.083503 Jun 07 14:37:22.973419 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: [pid: 103744|app: 0|req: 38/74] 10.222.0.85 () {60 vars in 1193 bytes} [Tue Jun 7 14:37:22 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:37:23.852141 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: DEBUG nova.api.openstack.wsgi [None req-b6f7d7b4-28dc-44dc-850f-ab32e2e2f9b8 admin admin] Calling method '>' {{(pid=103745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:37:23.853371 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: INFO nova.api.openstack.requestlog [None req-b6f7d7b4-28dc-44dc-850f-ab32e2e2f9b8 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001883 Jun 07 14:37:23.854029 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: [pid: 103745|app: 0|req: 37/75] 10.222.0.85 () {56 vars in 1074 bytes} [Tue Jun 7 14:37:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:37:24.049288 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG nova.api.openstack.wsgi [None req-f9d82daf-3f2b-4726-b924-00d0e5f8cd07 admin admin] Calling method '>' {{(pid=103744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:37:24.050456 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 07 14:37:24.050456 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: warnings.warn(msg) Jun 07 14:37:24.051643 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG oslo_concurrency.lockutils [None req-f9d82daf-3f2b-4726-b924-00d0e5f8cd07 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:37:24.052116 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG oslo_concurrency.lockutils [None req-f9d82daf-3f2b-4726-b924-00d0e5f8cd07 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:37:24.052930 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG oslo_concurrency.lockutils [None req-f9d82daf-3f2b-4726-b924-00d0e5f8cd07 admin admin] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:37:24.053354 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: DEBUG oslo_concurrency.lockutils [None req-f9d82daf-3f2b-4726-b924-00d0e5f8cd07 admin admin] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:37:24.075788 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: INFO nova.api.openstack.requestlog [None req-f9d82daf-3f2b-4726-b924-00d0e5f8cd07 admin admin] 10.222.0.85 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.081104 Jun 07 14:37:24.076361 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: [pid: 103744|app: 0|req: 39/76] 10.222.0.85 () {60 vars in 1193 bytes} [Tue Jun 7 14:37:23 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:38:22.613524 dv-cinder-844974-1-iscsi devstack@n-api.service[103743]: Tue Jun 7 14:38:22 2022 - graceful shutdown triggered... Jun 07 14:38:22.614090 dv-cinder-844974-1-iscsi devstack@n-api.service[103745]: Gracefully killing worker 2 (pid: 103745)... Jun 07 14:38:22.613649 dv-cinder-844974-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 07 14:38:22.614976 dv-cinder-844974-1-iscsi devstack@n-api.service[103744]: Gracefully killing worker 1 (pid: 103744)... Jun 07 14:38:23.614739 dv-cinder-844974-1-iscsi devstack@n-api.service[103743]: worker 1 buried after 1 seconds Jun 07 14:38:23.614739 dv-cinder-844974-1-iscsi devstack@n-api.service[103743]: worker 2 buried after 1 seconds Jun 07 14:38:23.614739 dv-cinder-844974-1-iscsi devstack@n-api.service[103743]: goodbye to uWSGI. Jun 07 14:38:23.616283 dv-cinder-844974-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 07 14:38:23.616879 dv-cinder-844974-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 07 14:38:23.619632 dv-cinder-844974-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 07 14:38:23.633164 dv-cinder-844974-1-iscsi devstack@n-api.service[118140]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 07 14:38:23.644386 dv-cinder-844974-1-iscsi devstack@n-api.service[118140]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jun 7 14:38:23 2022] *** Jun 07 14:38:23.644386 dv-cinder-844974-1-iscsi devstack@n-api.service[118140]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 07 14:38:23.644386 dv-cinder-844974-1-iscsi devstack@n-api.service[118140]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 07 14:38:23.644386 dv-cinder-844974-1-iscsi devstack@n-api.service[118140]: nodename: dv-cinder-844974-1-iscsi Jun 07 14:38:23.644386 dv-cinder-844974-1-iscsi devstack@n-api.service[118140]: machine: x86_64 Jun 07 14:38:23.644386 dv-cinder-844974-1-iscsi devstack@n-api.service[118140]: clock source: unix Jun 07 14:38:23.644386 dv-cinder-844974-1-iscsi devstack@n-api.service[118140]: pcre jit disabled Jun 07 14:38:23.644386 dv-cinder-844974-1-iscsi devstack@n-api.service[118140]: detected number of CPU cores: 4 Jun 07 14:38:23.644386 dv-cinder-844974-1-iscsi devstack@n-api.service[118140]: current working directory: / Jun 07 14:38:23.644386 dv-cinder-844974-1-iscsi devstack@n-api.service[118140]: detected binary path: /usr/bin/uwsgi-core Jun 07 14:38:23.644386 dv-cinder-844974-1-iscsi devstack@n-api.service[118140]: your processes number limit is 47680 Jun 07 14:38:23.645305 dv-cinder-844974-1-iscsi devstack@n-api.service[118140]: your memory page size is 4096 bytes Jun 07 14:38:23.645305 dv-cinder-844974-1-iscsi devstack@n-api.service[118140]: detected max file descriptor number: 2048 Jun 07 14:38:23.645305 dv-cinder-844974-1-iscsi devstack@n-api.service[118140]: lock engine: pthread robust mutexes Jun 07 14:38:23.645305 dv-cinder-844974-1-iscsi devstack@n-api.service[118140]: thunder lock: enabled Jun 07 14:38:23.645305 dv-cinder-844974-1-iscsi devstack@n-api.service[118140]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 07 14:38:23.645305 dv-cinder-844974-1-iscsi devstack@n-api.service[118140]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 07 14:38:23.692644 dv-cinder-844974-1-iscsi devstack@n-api.service[118140]: Python main interpreter initialized at 0x557e41ed49c0 Jun 07 14:38:23.692644 dv-cinder-844974-1-iscsi devstack@n-api.service[118140]: python threads support enabled Jun 07 14:38:23.692644 dv-cinder-844974-1-iscsi devstack@n-api.service[118140]: your server socket listen backlog is limited to 100 connections Jun 07 14:38:23.692644 dv-cinder-844974-1-iscsi devstack@n-api.service[118140]: your mercy for graceful operations on workers is 90 seconds Jun 07 14:38:23.693130 dv-cinder-844974-1-iscsi devstack@n-api.service[118140]: mapped 403077 bytes (393 KB) for 2 cores Jun 07 14:38:23.693130 dv-cinder-844974-1-iscsi devstack@n-api.service[118140]: *** Operational MODE: preforking *** Jun 07 14:38:23.693364 dv-cinder-844974-1-iscsi devstack@n-api.service[118140]: *** uWSGI is running in multiple interpreter mode *** Jun 07 14:38:23.693364 dv-cinder-844974-1-iscsi devstack@n-api.service[118140]: spawned uWSGI master process (pid: 118140) Jun 07 14:38:23.693627 dv-cinder-844974-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 07 14:38:23.694146 dv-cinder-844974-1-iscsi devstack@n-api.service[118140]: spawned uWSGI worker 1 (pid: 118157, cores: 1) Jun 07 14:38:23.694646 dv-cinder-844974-1-iscsi devstack@n-api.service[118140]: spawned uWSGI worker 2 (pid: 118158, cores: 1) Jun 07 14:38:23.694950 dv-cinder-844974-1-iscsi devstack@n-api.service[118140]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 07 14:38:24.948533 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 07 14:38:24.949520 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 07 14:38:25.797282 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 07 14:38:25.797282 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: from cryptography.utils import int_from_bytes Jun 07 14:38:25.797568 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 07 14:38:25.797568 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: from cryptography.utils import int_from_bytes Jun 07 14:38:25.807770 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 07 14:38:25.807770 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: from cryptography.utils import int_from_bytes Jun 07 14:38:25.808111 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 07 14:38:25.808111 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: from cryptography.utils import int_from_bytes Jun 07 14:38:28.194096 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 07 14:38:28.194667 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 07 14:38:28.194860 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 07 14:38:28.195222 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 07 14:38:28.195478 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 07 14:38:28.195874 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.196197 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.196550 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.196874 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.197208 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.197525 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.197847 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.198166 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.198497 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.198762 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.199082 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.199413 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844974-1-iscsi {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.199740 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.200050 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.200359 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.200699 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.201007 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.201334 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.201644 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.202217 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.202624 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.202902 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.203215 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.203556 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.203871 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.204765 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.205089 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.205400 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.205740 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.206053 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.206439 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844974-1-iscsi {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.206756 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.207068 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.207381 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.207804 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.208119 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.208450 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.208778 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.209106 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.209420 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.209748 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.210077 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.210447 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.210727 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.211031 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.211342 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.211655 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.211980 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.212290 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.212621 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.212971 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.213286 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.213629 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.213942 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.214267 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.214522 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.214777 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.215104 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.215430 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.215742 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.216051 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.216291 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 07 14:38:28.216767 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.216852 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 07 14:38:28.216936 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.217019 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.217170 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 07 14:38:28.217294 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.217544 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 07 14:38:28.217638 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.217803 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 07 14:38:28.217899 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.218166 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.218267 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.218500 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.218600 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.218808 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.218916 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.219118 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.219211 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.219446 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.219605 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.219786 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.219886 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.85 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.220112 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.220217 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.85 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.220442 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.220550 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.220788 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.220890 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.221081 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.221173 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.221402 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.221508 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.221724 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.221815 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844974-1-iscsi {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.222047 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.222147 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.222356 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.222503 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.222663 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.222767 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.222970 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.223070 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.223279 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.223381 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.223610 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.223713 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.223914 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.224066 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.224164 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.224449 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.224575 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.224766 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.224859 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.225075 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.225169 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.225381 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.225479 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.225690 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.225790 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.225998 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.226105 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.226301 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.226408 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.226604 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.226708 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.226912 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.227016 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.227219 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.227314 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.227527 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.227619 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.228011 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.228140 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844974-1-iscsi {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.228237 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.228317 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.228563 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.228694 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.228873 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.229012 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.229183 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.229445 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.229603 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.229759 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.229850 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.230043 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.230143 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.230371 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.230518 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.230702 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.230843 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.231007 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.231147 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.231334 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.231438 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.231641 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.231740 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.231951 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.232053 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.232276 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.232399 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.232609 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.232710 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.232914 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.233013 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.233226 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.233330 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.233532 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.233707 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.233843 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.233937 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.234148 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.234248 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.234401 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.234508 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.234713 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.234814 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.235041 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.235141 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.235436 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.235557 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.235740 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.235830 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.235963 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.236056 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.236215 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.236358 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.236567 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.236672 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.236897 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.236991 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.237215 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.237304 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.237527 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.237620 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.237833 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.237933 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.238143 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.238235 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.238453 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.238555 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.238762 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.238864 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.239071 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.239170 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.239376 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.239467 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.239697 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.239799 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.240014 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.240112 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.240340 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.240462 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.240683 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.240791 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.241002 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.241102 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.241345 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.241437 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.85 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.241646 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.85 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.241738 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.241993 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.242099 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.242295 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.242393 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.242612 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.242708 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.242921 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.243012 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.243246 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.243344 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.243560 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.243647 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.243867 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.243960 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.244176 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.244276 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.244509 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.244620 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.244835 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.244937 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.245154 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.245259 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.245477 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.245577 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.245798 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.245891 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.246103 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.246209 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.246416 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.246508 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.246742 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.246842 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.247060 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.247162 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.247370 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.247469 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.247680 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.247773 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.247988 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.248090 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.248296 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.248416 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.248641 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.248742 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.248951 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.249046 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.249264 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.249358 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.249597 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.249687 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.249912 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.250012 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.250223 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.250324 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.250533 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.250633 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.251366 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.251477 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.251691 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.251792 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.252004 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.252096 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.252316 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.252442 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.252652 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.252743 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.252961 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.253065 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.253271 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.253371 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.253599 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.253702 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.253910 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.254004 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.254219 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.254320 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.254532 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.254630 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.254843 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.254935 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.255150 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.255243 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.255462 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.255562 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.255773 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.255865 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.256080 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.256180 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.256427 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.256538 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.256713 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.256808 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.257023 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.257125 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.257327 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.257427 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.257651 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.257747 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.257957 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.258050 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.258262 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.258363 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.258569 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.258662 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.258875 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.258967 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.259183 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.259294 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.259490 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.259583 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.259816 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.259921 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.260101 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.260186 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.260443 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.260581 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.260774 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.260883 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.261086 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.261186 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.261653 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.261747 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.261963 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.262067 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.262293 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:38:28.262406 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.262631 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.262731 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.262974 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.263099 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.263300 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.263414 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.263620 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.263713 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.263935 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.264044 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.264251 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.264351 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.264598 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.264703 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.264912 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.265057 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.265216 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.265334 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.265551 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.265715 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.265869 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.266042 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.266259 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.266375 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.267112 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.267261 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.267426 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.267597 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.267814 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.267913 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.268154 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.268286 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.268504 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.268600 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.268816 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.268907 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.269131 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.269238 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.269443 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.269558 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.269750 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.269852 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.270057 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.270156 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.270371 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.270472 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.270683 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.270840 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.270988 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.271088 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.271296 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.271432 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.271603 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.271752 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.271912 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.272085 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.272238 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.272429 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.272574 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.272748 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.272881 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.273070 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.273191 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.273391 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.273496 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.273720 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.273815 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.274058 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.274160 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.274379 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.274480 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.274766 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.274857 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.275089 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.275183 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.275408 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.275502 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.275729 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.275835 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.276044 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.276146 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.276376 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.276510 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.276693 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.276830 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.277010 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.277114 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.277324 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.277424 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.277648 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.277754 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.277960 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.278052 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.278275 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.278375 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.278587 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.278688 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.278899 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.278997 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.279207 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.279300 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.279517 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.279610 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.279821 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.279913 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.280131 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.280231 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.280464 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.280574 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.280794 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.280970 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.281127 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.281222 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.281441 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.281535 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.281753 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.281958 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.282140 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.282306 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.282409 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.282625 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.282719 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.282942 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.283035 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.283263 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.283383 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.283576 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.283676 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.283897 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.283989 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.284214 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.284343 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.284549 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.284693 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.284867 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.285009 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.285180 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.285320 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.285492 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.285626 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.285800 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.285940 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.286119 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.286260 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.286432 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.286565 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.286754 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.286886 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.287070 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.287200 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.287385 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.287523 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.287697 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.287875 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.288047 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.288257 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.288582 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.288731 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.288884 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.289049 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.289219 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.289388 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.289534 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.289679 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.289781 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.289881 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.289974 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.290065 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.290185 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.290280 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.290497 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.290717 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.290912 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.291069 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.291227 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.291375 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.291543 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.291698 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.291794 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.291867 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.292059 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.292198 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.292392 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.292489 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.292718 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.292809 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.293033 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.293136 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.293362 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.293475 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.293685 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.293779 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.293993 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.294093 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.294301 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.294429 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.294627 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.294756 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.294937 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.295069 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.295243 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.295361 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.295548 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.295673 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.295849 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.295976 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.296196 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.296317 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.296530 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.296662 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.296839 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.296982 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.297158 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.297299 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.297482 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.297624 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.297822 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.297970 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.298147 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.298267 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.298458 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.298601 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.298768 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.298910 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.299089 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.299221 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.299404 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.299535 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.299716 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.299851 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.300029 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.300170 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.300340 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.300506 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.300656 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.300787 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.300972 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.301114 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.301300 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.301427 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.301610 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.301731 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.301925 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.302078 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.302281 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.302423 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.302562 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.302699 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.302828 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.303062 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.303219 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.303378 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.303666 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.303764 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.303997 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.304099 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.304316 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.304444 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.304662 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.304753 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.304989 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.305116 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.305307 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.305420 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.305624 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.305721 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.305941 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.306072 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.306267 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.306361 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.306584 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.306686 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.306909 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.307003 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.307225 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.307317 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.307546 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.307638 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.307860 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.307962 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.308177 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.308274 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.308509 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.308606 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.308822 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.308965 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.309135 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.309227 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.309442 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.309550 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.309749 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.309850 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.310057 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.310174 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.310365 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.310469 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.310682 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.310783 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.310991 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.311092 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.311309 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.311447 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.311615 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.311713 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.311944 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.312048 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.312291 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.312419 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.316789 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.316937 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.317061 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.317159 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.317257 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.317345 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.317431 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.317522 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.317608 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.317716 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.317716 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.317940 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.318035 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.318132 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.318218 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.318303 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.318396 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.318572 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.318661 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.318746 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.318837 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.318937 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.319025 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.319118 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.319118 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.319275 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.319359 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.319455 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.319580 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.319675 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.319761 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.319853 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.319939 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.320037 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.320130 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.320217 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.320309 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.320420 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.320521 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.320661 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.320756 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.320849 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.320934 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.321019 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.321112 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.321198 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.321298 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.321385 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.321457 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.321528 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.321625 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.321752 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.321853 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.321946 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.322040 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.322127 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.322292 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.322382 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.322470 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.322470 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.322609 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.322693 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.322790 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.322883 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.322968 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.323187 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.323337 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.323517 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.323621 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.323825 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.323938 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.324139 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.324304 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.324546 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.324650 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.324769 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.324872 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.325076 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.325170 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.325405 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.325507 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.325719 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.325868 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.326027 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.326121 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.326335 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.326430 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.326645 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.326924 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.327027 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.327244 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.327345 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.327554 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.327655 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.327882 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.327972 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.328205 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.328306 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.328582 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.328678 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.328918 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.329032 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.330163 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.330289 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.330386 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.330472 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.330553 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.330775 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.331008 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.331112 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.331379 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.331496 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.331690 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.331997 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.332102 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.332310 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.332645 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.332763 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.332984 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.333174 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.333404 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.333590 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.333684 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.333895 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.334357 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.334561 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.334561 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.335021 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.335208 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.335208 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.335523 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.335679 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.335851 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.336123 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.336123 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.336496 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.336660 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.336813 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.336964 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.337125 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.337373 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.337533 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.337687 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.337989 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.338197 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.338358 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.338565 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.338736 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.338898 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.339152 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.339322 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.339515 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.339728 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.339897 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.341503 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.342288 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.342458 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.342661 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.342835 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.342835 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.343127 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.343253 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.343253 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.343253 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.343714 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.343829 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.343829 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.344036 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.344156 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.344277 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.345484 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.345663 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.345779 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.345779 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.345964 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.346054 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.346143 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.346230 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.346310 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.346396 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.346492 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.346578 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.346684 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.346784 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.346886 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.346982 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.346982 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.347161 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.347252 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.347344 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.347428 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.347524 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.347610 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.347701 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.347786 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.347877 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.347877 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.348041 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.348132 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.348222 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.348315 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.348439 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.348523 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.348622 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.348796 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.349111 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.349246 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.349430 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.349575 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.349748 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.349902 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.350055 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.350224 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.350482 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.350585 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.350819 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.350935 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.351109 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.351205 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.351423 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.351531 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.351732 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.351833 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.352042 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.352169 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.352396 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.352514 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.352748 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.352915 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.353043 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.353136 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.353349 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.353450 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.353657 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.353761 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.353974 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.354067 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.354280 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.354373 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.354678 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.354850 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.355064 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.355237 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.355405 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.355568 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.355722 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.355875 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.356047 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.356325 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.356510 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.356659 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.356763 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.357049 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.357149 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.357432 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.357534 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.357687 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.357780 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.357995 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.358084 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.358316 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.358399 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.358637 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.358719 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.358965 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.359100 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.359276 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.359379 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.359594 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.359693 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.359905 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.359997 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.360749 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.360852 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.361080 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.361184 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.361401 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.361586 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.361718 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.361821 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.362030 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.362185 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.362343 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.362456 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.362655 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.362748 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.362967 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.363125 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.363302 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.363488 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.365632 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.365751 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.365886 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.365999 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.366087 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.366184 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.366270 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.366353 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.366353 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.366577 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.366679 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.366816 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.366906 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.366997 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.367100 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.367185 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.367266 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.367358 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.367450 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.367596 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.367690 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.367783 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.367882 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.367967 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.368057 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.368141 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.368231 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.368357 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.368494 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.368583 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.368667 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.368758 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.368850 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.368936 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.369027 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.369111 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.369234 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.369383 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.369543 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.369717 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.369872 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.370038 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.370183 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.370355 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.370492 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.370686 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.370788 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.371019 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.371113 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.371353 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.371446 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.371666 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.371768 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.371982 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.372076 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.372300 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.372466 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.377276 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.377382 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.378439 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.379024 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.379115 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.379210 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.379305 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.379467 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.379618 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.379723 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.379824 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.379913 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.380005 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.380136 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.380270 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.380439 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.380559 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.380684 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.380797 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.380907 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.381066 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.381193 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.381313 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.381432 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.381432 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.381652 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.381762 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.381886 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.381998 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.382114 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.382225 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.382334 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.382444 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.382563 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.382682 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.382799 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.382917 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.383066 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.383195 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.383313 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.383432 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.383543 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.383652 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.383768 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.383886 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.383997 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.384224 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.384342 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.384479 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.384593 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.384716 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.384828 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.384945 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.385063 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.385299 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.385424 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.385533 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.385627 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.385713 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.385797 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.385920 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.386061 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.386182 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.386565 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.386678 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.386796 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.386907 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.387205 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.387337 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.387449 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.387565 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.387646 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.387725 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.387810 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.387889 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.387889 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.387889 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.388086 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.388158 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.388158 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.388301 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.388425 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.388506 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.388506 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.388658 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.388740 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.388812 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.388880 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.388949 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.389017 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.389094 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.389172 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.389242 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.389242 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.389365 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.389434 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.389511 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.389724 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.389815 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.390042 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.390132 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.390359 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.390450 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.390675 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.390790 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.391011 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.391239 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.391344 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.391578 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.391746 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.393700 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.393807 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.393882 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.397878 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.398013 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.398109 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.398210 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.398296 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.398388 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.398482 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.398575 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.398667 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.398764 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.398857 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.398971 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.399065 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.399158 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.399243 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.399326 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.399486 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.399589 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.399676 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.399676 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.399829 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.399912 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.400008 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.400100 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.400185 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.400268 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.400358 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.400463 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.400567 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.400660 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.400745 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.400828 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.400911 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.400994 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.401085 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.401170 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.401253 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.401337 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.401420 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.401510 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.401605 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.401690 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.401782 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.401867 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.401951 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.401951 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.402153 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.402290 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.402381 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.402472 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.402565 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.402664 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.402750 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.402851 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.402945 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.403037 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.403127 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.403229 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.403372 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.403513 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.403608 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.403701 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.403793 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.403879 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.403958 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.404079 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.404153 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.404222 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.404323 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.404440 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.404516 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.404586 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.404668 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.404668 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.404814 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.405040 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.405362 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.405467 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.405716 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.405802 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.406024 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.406117 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.406346 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.406428 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.406746 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.406905 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.407124 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.407307 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.407469 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.407634 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.407800 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.407974 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.408133 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.408311 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.408506 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.408839 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.408936 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.409155 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.409248 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.409541 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.409820 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.409934 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.410078 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.410183 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.410398 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.410493 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.410717 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.410818 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.411039 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.411144 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.411358 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.411461 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.411670 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.411769 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.411983 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.412084 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.412291 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.412440 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.412654 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.412990 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.413308 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.413625 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.413940 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.414173 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.414271 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.414506 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.414609 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.414861 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.415082 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.415297 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.415426 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.415590 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.415702 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.415967 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.416108 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.416209 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.416303 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.416544 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.416687 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.416881 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.417004 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.417234 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.417358 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.417545 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.417676 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.417872 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.418002 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.418197 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.418320 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.418525 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.418639 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.418849 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.418941 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.419173 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.419267 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.419493 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.419588 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.419819 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.419913 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.420147 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.420318 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.420538 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.428684 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.428684 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.428895 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.428986 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.429081 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.429176 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.429268 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.429361 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.429446 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.429538 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.429636 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.429722 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.429806 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.429889 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.429980 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.430064 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.430156 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.430242 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.430333 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.430333 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.430497 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.430595 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.430687 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.430772 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.430862 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.430947 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.431031 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.431122 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.431208 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.431291 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.431382 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.431467 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.431551 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.431643 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.431734 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.431826 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.431918 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.432017 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.432136 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.432229 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.432316 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.432438 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.432534 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.432621 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.432714 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.432806 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.432893 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.432977 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.433059 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.433152 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.433244 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.433337 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.433423 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.433507 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.433590 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.433682 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.433774 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.433860 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.433933 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.434004 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.434074 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.434155 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.434228 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.434304 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.434376 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.434446 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.434524 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.434608 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.434693 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.434783 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.434872 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.434962 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.435055 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.435140 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.435246 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.435475 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.435578 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.435662 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.435757 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.435842 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.435926 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.436035 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.436286 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.436400 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.436512 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.436608 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.436693 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.436777 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.436867 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.436960 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.437046 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.437136 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.437221 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.437305 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.437390 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.437487 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.437582 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.437701 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.437796 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.437881 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.437973 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.438073 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.438073 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.438235 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.438951 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.439086 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.439202 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.439299 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.439393 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.439479 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.439703 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.439805 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.440017 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.440112 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.440444 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.440594 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.440786 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.440957 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.441122 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.441267 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.441437 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.441610 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.441733 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.442046 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.442236 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.442364 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.442569 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.442720 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.442888 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.443031 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.443345 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.443791 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.443899 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.443975 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.444046 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.444300 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.444412 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.444647 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.444750 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.444955 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.445069 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.445368 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.445493 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.445570 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.445641 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.445913 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.446027 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.446110 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.446441 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.446535 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.446607 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.446820 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.446929 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.447048 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.447286 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.447425 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.447544 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.447785 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.447961 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.448046 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.448126 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.448453 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.448563 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.448757 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.449060 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.449550 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.449682 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.449876 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.449981 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.450184 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.450286 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.450507 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.450614 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.450821 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.450925 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.451137 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.451241 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.451486 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.451592 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.451809 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.451904 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.452101 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.452201 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.452472 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.452582 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.452762 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.452860 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.453091 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.453189 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.453415 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.453521 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.453735 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.453842 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.454097 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.454204 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.454415 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.454511 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.454730 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.454836 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.455050 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.455155 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.455519 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.455621 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.455703 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.456070 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.456164 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.456247 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.456327 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.456621 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.456729 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.456948 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.457045 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.457281 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.457387 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.457659 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.457773 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.457961 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.458053 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.458256 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.458353 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.458575 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.458681 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.458889 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.458987 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.459372 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.459581 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.459736 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.459931 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.460088 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.460238 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.460419 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.460671 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.460842 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.460993 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.461142 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.461291 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.461439 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.461628 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.461628 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.461942 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.462093 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.462249 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.462398 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.462557 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.462748 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.462903 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.463060 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.463220 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.463376 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.463526 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.463687 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.463846 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.464028 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.464184 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.464333 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.464607 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.464804 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.464960 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.465109 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.465259 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.465408 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.465595 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.465821 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.465976 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 07 14:38:28.466156 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.466156 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.466156 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.466690 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.466690 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.467044 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.467356 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.467688 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.468171 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.468521 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.468903 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.469236 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.469579 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.474578 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.474578 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.474578 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.474578 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.474578 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.474578 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.474578 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.474578 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.475253 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.475253 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.475253 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.475253 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.475253 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.475253 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.475253 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.475253 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.475874 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.475874 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.475874 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.475874 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.476203 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.476427 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.476742 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.477056 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.477355 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.477678 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.477995 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.478300 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.478608 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.478920 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.479236 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.479545 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.479853 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.480159 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.480489 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.480834 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.481175 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.481494 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.481825 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.482142 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.482470 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.482782 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.483110 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.483438 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.483827 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.484142 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.484503 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.484821 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.485682 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.485987 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.486307 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.486623 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.486936 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.487283 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.487635 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.487938 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.489068 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.489068 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.489068 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.489550 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.489550 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.489974 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.490328 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.490655 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.491057 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.491320 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.491606 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.491931 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.492256 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.492625 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.492965 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.493283 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.493625 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.493950 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.494315 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.494741 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.495337 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.495876 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.496212 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.496563 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.496887 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:38:28.497140 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 07 14:38:28.529119 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO dbcounter [None req-42cdaf70-47b7-4fb3-b9ff-530d9cd9a81f None None] Registered counter for database nova_api Jun 07 14:38:28.550387 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_db.sqlalchemy.engines [None req-42cdaf70-47b7-4fb3-b9ff-530d9cd9a81f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118158) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 14:38:28.557299 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG dbcounter [-] [118158] Writer thread running {{(pid=118158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 14:38:28.560471 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO dbcounter [None req-d8279b5f-a43f-448c-a27a-58254b62d5c4 None None] Registered counter for database nova_api Jun 07 14:38:28.581488 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_db.sqlalchemy.engines [None req-d8279b5f-a43f-448c-a27a-58254b62d5c4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118157) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 14:38:28.588702 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG dbcounter [-] [118157] Writer thread running {{(pid=118157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 14:38:28.615766 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.context [None req-42cdaf70-47b7-4fb3-b9ff-530d9cd9a81f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),dc303ae0-773f-43ce-b623-3e851eed4eb7(cell1) {{(pid=118158) load_cells /opt/stack/nova/nova/context.py:464}} Jun 07 14:38:28.620198 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-42cdaf70-47b7-4fb3-b9ff-530d9cd9a81f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:38:28.621890 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-42cdaf70-47b7-4fb3-b9ff-530d9cd9a81f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:38:28.622815 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-42cdaf70-47b7-4fb3-b9ff-530d9cd9a81f None None] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:38:28.624892 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-42cdaf70-47b7-4fb3-b9ff-530d9cd9a81f None None] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:38:28.627515 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO dbcounter [None req-42cdaf70-47b7-4fb3-b9ff-530d9cd9a81f None None] Registered counter for database nova_cell0 Jun 07 14:38:28.633145 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO dbcounter [None req-42cdaf70-47b7-4fb3-b9ff-530d9cd9a81f None None] Registered counter for database nova_cell1 Jun 07 14:38:28.641114 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_db.sqlalchemy.engines [None req-42cdaf70-47b7-4fb3-b9ff-530d9cd9a81f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118158) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 14:38:28.646571 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG dbcounter [-] [118158] Writer thread running {{(pid=118158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 14:38:28.648011 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_db.sqlalchemy.engines [None req-42cdaf70-47b7-4fb3-b9ff-530d9cd9a81f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118158) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 14:38:28.650779 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.context [None req-d8279b5f-a43f-448c-a27a-58254b62d5c4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),dc303ae0-773f-43ce-b623-3e851eed4eb7(cell1) {{(pid=118157) load_cells /opt/stack/nova/nova/context.py:464}} Jun 07 14:38:28.655273 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-d8279b5f-a43f-448c-a27a-58254b62d5c4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:38:28.657037 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-d8279b5f-a43f-448c-a27a-58254b62d5c4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:38:28.657875 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-d8279b5f-a43f-448c-a27a-58254b62d5c4 None None] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:38:28.660001 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-d8279b5f-a43f-448c-a27a-58254b62d5c4 None None] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:38:28.662129 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO dbcounter [None req-d8279b5f-a43f-448c-a27a-58254b62d5c4 None None] Registered counter for database nova_cell0 Jun 07 14:38:28.667898 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO dbcounter [None req-d8279b5f-a43f-448c-a27a-58254b62d5c4 None None] Registered counter for database nova_cell1 Jun 07 14:38:28.676400 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_db.sqlalchemy.engines [None req-d8279b5f-a43f-448c-a27a-58254b62d5c4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118157) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 14:38:28.679008 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_db.sqlalchemy.engines [None req-d8279b5f-a43f-448c-a27a-58254b62d5c4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118157) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 14:38:28.686413 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG dbcounter [-] [118157] Writer thread running {{(pid=118157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 14:38:28.687712 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG dbcounter [-] [118157] Writer thread running {{(pid=118157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 14:38:28.793039 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG dbcounter [-] [118158] Writer thread running {{(pid=118158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 14:38:28.803185 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO dbcounter [None req-42cdaf70-47b7-4fb3-b9ff-530d9cd9a81f None None] Registered counter for database nova_cell0 Jun 07 14:38:28.810116 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_db.sqlalchemy.engines [None req-42cdaf70-47b7-4fb3-b9ff-530d9cd9a81f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118158) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 14:38:28.814772 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG dbcounter [-] [118158] Writer thread running {{(pid=118158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 14:38:28.835740 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO dbcounter [None req-d8279b5f-a43f-448c-a27a-58254b62d5c4 None None] Registered counter for database nova_cell0 Jun 07 14:38:28.843834 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_db.sqlalchemy.engines [None req-d8279b5f-a43f-448c-a27a-58254b62d5c4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118157) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 14:38:28.849246 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG dbcounter [-] [118157] Writer thread running {{(pid=118157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 14:38:29.262105 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: WARNING keystonemiddleware.auth_token [None req-42cdaf70-47b7-4fb3-b9ff-530d9cd9a81f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 07 14:38:29.270091 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: WARNING keystonemiddleware.auth_token [None req-42cdaf70-47b7-4fb3-b9ff-530d9cd9a81f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 07 14:38:29.287014 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: WARNING keystonemiddleware.auth_token [None req-d8279b5f-a43f-448c-a27a-58254b62d5c4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 07 14:38:29.294308 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: WARNING keystonemiddleware.auth_token [None req-d8279b5f-a43f-448c-a27a-58254b62d5c4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 07 14:38:29.502796 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: WARNING keystonemiddleware.auth_token [None req-42cdaf70-47b7-4fb3-b9ff-530d9cd9a81f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 07 14:38:29.508909 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: WARNING keystonemiddleware.auth_token [None req-42cdaf70-47b7-4fb3-b9ff-530d9cd9a81f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 07 14:38:29.514338 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557e41ed49c0 pid: 118158 (default app) Jun 07 14:38:29.520115 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: WARNING keystonemiddleware.auth_token [None req-d8279b5f-a43f-448c-a27a-58254b62d5c4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 07 14:38:29.526088 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: WARNING keystonemiddleware.auth_token [None req-d8279b5f-a43f-448c-a27a-58254b62d5c4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 07 14:38:29.531150 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557e41ed49c0 pid: 118157 (default app) Jun 07 14:39:12.039544 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG dbcounter [-] [118158] Writing DB stats nova_api:SELECT=3 {{(pid=118158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:39:12.040675 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG dbcounter [-] [118158] Writing DB stats nova_cell0:SELECT=3 {{(pid=118158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:39:12.042408 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG dbcounter [-] [118158] Writing DB stats nova_cell1:SELECT=3 {{(pid=118158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:39:12.044916 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG dbcounter [-] [118158] Writing DB stats nova_cell0:SELECT=3 {{(pid=118158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:39:13.380388 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-7c7d600b-8cbd-4831-84f7-779de636e71a tempest-VolumesSnapshotsTestJSON-2062503638 tempest-VolumesSnapshotsTestJSON-2062503638-project] Action: 'create', calling method: .version_select at 0x7f5f88f2c5e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-2024827324"}} {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:39:13.734848 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG dbcounter [-] [118157] Writing DB stats nova_api:SELECT=3 {{(pid=118157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:39:13.736785 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG dbcounter [-] [118157] Writing DB stats nova_cell1:SELECT=3 {{(pid=118157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:39:13.742104 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG dbcounter [-] [118157] Writing DB stats nova_cell0:SELECT=3 {{(pid=118157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:39:13.744050 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG dbcounter [-] [118157] Writing DB stats nova_cell0:SELECT=3 {{(pid=118157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:39:15.126651 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-c147948a-5ab4-4576-9da4-bd17465f5ee1 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1091948792", "imageRef": "7802ce25-d370-43a3-8d85-0257d644d539", "flavorRef": "452", "networks": [{"uuid": "9425fadb-7f7b-435c-9cea-56fa546f8a7b"}]}} {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:39:15.706067 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.network.neutron [None req-c147948a-5ab4-4576-9da4-bd17465f5ee1 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] validate_networks() for [('9425fadb-7f7b-435c-9cea-56fa546f8a7b', None, None, None, None, None)] {{(pid=118157) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 14:39:15.709528 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-7c7d600b-8cbd-4831-84f7-779de636e71a tempest-VolumesSnapshotsTestJSON-2062503638 tempest-VolumesSnapshotsTestJSON-2062503638-project] 10.222.0.85 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.646546 Jun 07 14:39:15.709528 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 1/1] 10.222.0.85 () {60 vars in 1154 bytes} [Tue Jun 7 14:39:12 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3651 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 07 14:39:15.709528 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-9b0c1651-a3b4-4385-add0-ce19eb9761f2 tempest-VolumesSnapshotsTestJSON-2062503638 tempest-VolumesSnapshotsTestJSON-2062503638-project] Calling method '.version_select at 0x7f5f88df65e0>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:15.853068 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-9b0c1651-a3b4-4385-add0-ce19eb9761f2 tempest-VolumesSnapshotsTestJSON-2062503638 tempest-VolumesSnapshotsTestJSON-2062503638-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/e46038e4-d7dd-4b88-8019-fe25a6b8ce0d" status: 200 len: 345 microversion: 2.1 time: 0.163115 Jun 07 14:39:15.858080 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 2/2] 10.222.0.85 () {58 vars in 1244 bytes} [Tue Jun 7 14:39:15 2022] GET /compute/v2.1/os-volumes/e46038e4-d7dd-4b88-8019-fe25a6b8ce0d => generated 345 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 14:39:16.634064 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-51f34b07-9355-4abd-9a2d-edc9285af036 tempest-VolumesTestJSON-1217626432 tempest-VolumesTestJSON-1217626432-project] Calling method '.version_select at 0x7f5f88df6790>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:16.727074 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-51f34b07-9355-4abd-9a2d-edc9285af036 tempest-VolumesTestJSON-1217626432 tempest-VolumesTestJSON-1217626432-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/cd4e92b1-f23b-4a8e-aa7d-44da45226865" status: 200 len: 351 microversion: 2.1 time: 0.097689 Jun 07 14:39:16.728311 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 3/3] 10.222.0.85 () {58 vars in 1244 bytes} [Tue Jun 7 14:39:16 2022] GET /compute/v2.1/os-volumes/cd4e92b1-f23b-4a8e-aa7d-44da45226865 => generated 351 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 14:39:16.866967 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-ab14a0da-5378-48f0-b211-644858afd2a6 tempest-VolumesSnapshotsTestJSON-2062503638 tempest-VolumesSnapshotsTestJSON-2062503638-project] Calling method '.version_select at 0x7f5f88df6dc0>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:16.981659 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-ab14a0da-5378-48f0-b211-644858afd2a6 tempest-VolumesSnapshotsTestJSON-2062503638 tempest-VolumesSnapshotsTestJSON-2062503638-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/e46038e4-d7dd-4b88-8019-fe25a6b8ce0d" status: 200 len: 346 microversion: 2.1 time: 0.118414 Jun 07 14:39:16.982216 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 4/4] 10.222.0.85 () {58 vars in 1244 bytes} [Tue Jun 7 14:39:16 2022] GET /compute/v2.1/os-volumes/e46038e4-d7dd-4b88-8019-fe25a6b8ce0d => generated 346 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 14:39:16.993689 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-84aaa1df-8917-4d07-ab2d-8e6d7e35d0eb tempest-VolumesSnapshotsTestJSON-2062503638 tempest-VolumesSnapshotsTestJSON-2062503638-project] Action: 'create', calling method: .version_select at 0x7f5f88e0d430>, body: {"snapshot": {"volume_id": "e46038e4-d7dd-4b88-8019-fe25a6b8ce0d", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1379955152"}} {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:39:17.239972 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.virt.hardware [None req-c147948a-5ab4-4576-9da4-bd17465f5ee1 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Flavor limits 0:0:0 {{(pid=118157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 14:39:17.240546 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.virt.hardware [None req-c147948a-5ab4-4576-9da4-bd17465f5ee1 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Image limits 0:0:0 {{(pid=118157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 14:39:17.241516 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.virt.hardware [None req-c147948a-5ab4-4576-9da4-bd17465f5ee1 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Flavor pref 0:0:0 {{(pid=118157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 14:39:17.241936 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.virt.hardware [None req-c147948a-5ab4-4576-9da4-bd17465f5ee1 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Image pref 0:0:0 {{(pid=118157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 14:39:17.242787 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.virt.hardware [None req-c147948a-5ab4-4576-9da4-bd17465f5ee1 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 14:39:17.267764 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-c147948a-5ab4-4576-9da4-bd17465f5ee1 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:17.267764 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-c147948a-5ab4-4576-9da4-bd17465f5ee1 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:17.268562 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-c147948a-5ab4-4576-9da4-bd17465f5ee1 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:17.269005 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-c147948a-5ab4-4576-9da4-bd17465f5ee1 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:17.333006 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.quota [None req-c147948a-5ab4-4576-9da4-bd17465f5ee1 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Getting quotas for project 1bd7cee3f5704d01ae9df6d300b30004. Resources: {'instances', 'cores', 'ram'} {{(pid=118157) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 14:39:17.354225 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.quota [None req-c147948a-5ab4-4576-9da4-bd17465f5ee1 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Getting quotas for user d800b8efe792477bac3ca063920a4a9a and project 1bd7cee3f5704d01ae9df6d300b30004. Resources: {'instances', 'cores', 'ram'} {{(pid=118157) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 14:39:17.370831 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-c147948a-5ab4-4576-9da4-bd17465f5ee1 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Going to run 1 instances... {{(pid=118157) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 14:39:17.375871 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-c147948a-5ab4-4576-9da4-bd17465f5ee1 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] [instance: af1af1be-6244-4c4f-ac6a-918ace6e2f1d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7802ce25-d370-43a3-8d85-0257d644d539',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118157) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 14:39:17.607021 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-c147948a-5ab4-4576-9da4-bd17465f5ee1 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.883920 Jun 07 14:39:17.607686 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 1/5] 10.222.0.85 () {60 vars in 1146 bytes} [Tue Jun 7 14:39:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 3887 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 14:39:17.619978 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-2ad09a41-d9cb-43fe-b9dc-1e83445bf0b1 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:17.620921 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-2ad09a41-d9cb-43fe-b9dc-1e83445bf0b1 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] [instance: af1af1be-6244-4c4f-ac6a-918ace6e2f1d] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:39:17.634336 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-84aaa1df-8917-4d07-ab2d-8e6d7e35d0eb tempest-VolumesSnapshotsTestJSON-2062503638 tempest-VolumesSnapshotsTestJSON-2062503638-project] 10.222.0.85 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.641629 Jun 07 14:39:17.634336 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 5/6] 10.222.0.85 () {60 vars in 1161 bytes} [Tue Jun 7 14:39:16 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 14:39:17.647160 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-ff0e4773-5774-452a-bde3-7cd6831517a2 tempest-VolumesSnapshotsTestJSON-2062503638 tempest-VolumesSnapshotsTestJSON-2062503638-project] Calling method '.version_select at 0x7f5f88df6d30>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:17.749090 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-ff0e4773-5774-452a-bde3-7cd6831517a2 tempest-VolumesSnapshotsTestJSON-2062503638 tempest-VolumesSnapshotsTestJSON-2062503638-project] 10.222.0.85 "GET /compute/v2.1/os-snapshots/dee0d035-8f6e-4d7d-a724-bce160bd4750" status: 200 len: 287 microversion: 2.1 time: 0.106645 Jun 07 14:39:17.751647 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 6/7] 10.222.0.85 () {58 vars in 1250 bytes} [Tue Jun 7 14:39:17 2022] GET /compute/v2.1/os-snapshots/dee0d035-8f6e-4d7d-a724-bce160bd4750 => generated 287 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:39:17.763583 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-00c12c54-b4ba-427e-a950-85cf510ebfb9 tempest-VolumesSnapshotsTestJSON-2062503638 tempest-VolumesSnapshotsTestJSON-2062503638-project] Calling method '.version_select at 0x7f5f88df6820>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:17.860484 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-00c12c54-b4ba-427e-a950-85cf510ebfb9 tempest-VolumesSnapshotsTestJSON-2062503638 tempest-VolumesSnapshotsTestJSON-2062503638-project] 10.222.0.85 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.100421 Jun 07 14:39:17.861338 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 7/8] 10.222.0.85 () {58 vars in 1139 bytes} [Tue Jun 7 14:39:17 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 14:39:17.882264 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-bb5110ab-9008-479c-8cef-93bf2eb1546d tempest-VolumesSnapshotsTestJSON-2062503638 tempest-VolumesSnapshotsTestJSON-2062503638-project] Calling method '.version_select at 0x7f5f88e0d1f0>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:17.991428 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-bb5110ab-9008-479c-8cef-93bf2eb1546d tempest-VolumesSnapshotsTestJSON-2062503638 tempest-VolumesSnapshotsTestJSON-2062503638-project] 10.222.0.85 "GET /compute/v2.1/os-snapshots/dee0d035-8f6e-4d7d-a724-bce160bd4750" status: 200 len: 287 microversion: 2.1 time: 0.118057 Jun 07 14:39:17.996105 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 8/9] 10.222.0.85 () {58 vars in 1250 bytes} [Tue Jun 7 14:39:17 2022] GET /compute/v2.1/os-snapshots/dee0d035-8f6e-4d7d-a724-bce160bd4750 => generated 287 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:39:18.076680 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-2ad09a41-d9cb-43fe-b9dc-1e83445bf0b1 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd800b8efe792477bac3ca063920a4a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd7cee3f5704d01ae9df6d300b30004', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:39:18.120868 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-2ad09a41-d9cb-43fe-b9dc-1e83445bf0b1 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] 10.222.0.85 "GET /compute/v2.1/servers/af1af1be-6244-4c4f-ac6a-918ace6e2f1d" status: 200 len: 1215 microversion: 2.1 time: 0.505268 Jun 07 14:39:18.126324 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 2/10] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:39:17 2022] GET /compute/v2.1/servers/af1af1be-6244-4c4f-ac6a-918ace6e2f1d => generated 1215 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:39:19.004417 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-f102a506-cf0e-4f05-b203-55621eb98d4a tempest-VolumesSnapshotsTestJSON-2062503638 tempest-VolumesSnapshotsTestJSON-2062503638-project] Calling method '.version_select at 0x7f5f88df6790>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:19.090392 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-f102a506-cf0e-4f05-b203-55621eb98d4a tempest-VolumesSnapshotsTestJSON-2062503638 tempest-VolumesSnapshotsTestJSON-2062503638-project] 10.222.0.85 "GET /compute/v2.1/os-snapshots/dee0d035-8f6e-4d7d-a724-bce160bd4750" status: 200 len: 287 microversion: 2.1 time: 0.083255 Jun 07 14:39:19.090392 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 9/11] 10.222.0.85 () {58 vars in 1250 bytes} [Tue Jun 7 14:39:18 2022] GET /compute/v2.1/os-snapshots/dee0d035-8f6e-4d7d-a724-bce160bd4750 => generated 287 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:39:19.181502 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-72359d68-d938-4974-9234-7a0ae5be9943 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:19.182266 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-72359d68-d938-4974-9234-7a0ae5be9943 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] [instance: af1af1be-6244-4c4f-ac6a-918ace6e2f1d] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:39:19.719378 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-72359d68-d938-4974-9234-7a0ae5be9943 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd800b8efe792477bac3ca063920a4a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd7cee3f5704d01ae9df6d300b30004', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:39:19.731083 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-72359d68-d938-4974-9234-7a0ae5be9943 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] 10.222.0.85 "GET /compute/v2.1/servers/af1af1be-6244-4c4f-ac6a-918ace6e2f1d" status: 200 len: 1215 microversion: 2.1 time: 0.586904 Jun 07 14:39:19.733791 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 3/12] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:39:19 2022] GET /compute/v2.1/servers/af1af1be-6244-4c4f-ac6a-918ace6e2f1d => generated 1215 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:39:20.098074 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-49903866-8cf2-4b85-9235-a008e01a2542 tempest-VolumesSnapshotsTestJSON-2062503638 tempest-VolumesSnapshotsTestJSON-2062503638-project] Calling method '.version_select at 0x7f5f88df6e50>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:20.155470 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-49903866-8cf2-4b85-9235-a008e01a2542 tempest-VolumesSnapshotsTestJSON-2062503638 tempest-VolumesSnapshotsTestJSON-2062503638-project] 10.222.0.85 "GET /compute/v2.1/os-snapshots/dee0d035-8f6e-4d7d-a724-bce160bd4750" status: 200 len: 287 microversion: 2.1 time: 0.063184 Jun 07 14:39:20.156088 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 10/13] 10.222.0.85 () {58 vars in 1250 bytes} [Tue Jun 7 14:39:20 2022] GET /compute/v2.1/os-snapshots/dee0d035-8f6e-4d7d-a724-bce160bd4750 => generated 287 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:39:20.750700 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-ab751150-65dc-45e2-a7e5-13dd68e3a754 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:20.751903 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-ab751150-65dc-45e2-a7e5-13dd68e3a754 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] [instance: af1af1be-6244-4c4f-ac6a-918ace6e2f1d] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:39:20.768405 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-ab751150-65dc-45e2-a7e5-13dd68e3a754 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:20.769444 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-ab751150-65dc-45e2-a7e5-13dd68e3a754 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:20.773872 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-ab751150-65dc-45e2-a7e5-13dd68e3a754 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:20.773872 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-ab751150-65dc-45e2-a7e5-13dd68e3a754 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:21.081651 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-ab751150-65dc-45e2-a7e5-13dd68e3a754 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd800b8efe792477bac3ca063920a4a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd7cee3f5704d01ae9df6d300b30004', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:39:21.101519 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-ab751150-65dc-45e2-a7e5-13dd68e3a754 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] 10.222.0.85 "GET /compute/v2.1/servers/af1af1be-6244-4c4f-ac6a-918ace6e2f1d" status: 200 len: 1219 microversion: 2.1 time: 0.354810 Jun 07 14:39:21.102863 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 4/14] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:39:20 2022] GET /compute/v2.1/servers/af1af1be-6244-4c4f-ac6a-918ace6e2f1d => generated 1219 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:39:21.167592 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-fc99707a-115b-46fb-9230-40f3bdfa966e tempest-VolumesSnapshotsTestJSON-2062503638 tempest-VolumesSnapshotsTestJSON-2062503638-project] Calling method '.version_select at 0x7f5f88e0d5e0>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:21.249989 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-fc99707a-115b-46fb-9230-40f3bdfa966e tempest-VolumesSnapshotsTestJSON-2062503638 tempest-VolumesSnapshotsTestJSON-2062503638-project] 10.222.0.85 "GET /compute/v2.1/os-snapshots/dee0d035-8f6e-4d7d-a724-bce160bd4750" status: 200 len: 287 microversion: 2.1 time: 0.085822 Jun 07 14:39:21.250801 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 11/15] 10.222.0.85 () {58 vars in 1250 bytes} [Tue Jun 7 14:39:21 2022] GET /compute/v2.1/os-snapshots/dee0d035-8f6e-4d7d-a724-bce160bd4750 => generated 287 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:39:22.119080 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-69cb0bd7-d7f7-43cc-b7bd-3fd0a28052a5 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:22.120008 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-69cb0bd7-d7f7-43cc-b7bd-3fd0a28052a5 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] [instance: af1af1be-6244-4c4f-ac6a-918ace6e2f1d] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:39:22.138912 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-69cb0bd7-d7f7-43cc-b7bd-3fd0a28052a5 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:22.139817 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-69cb0bd7-d7f7-43cc-b7bd-3fd0a28052a5 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:22.141305 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-69cb0bd7-d7f7-43cc-b7bd-3fd0a28052a5 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:22.141815 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-69cb0bd7-d7f7-43cc-b7bd-3fd0a28052a5 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:22.266791 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-b05e0bb6-fca5-4d4d-8439-b12fa04a043d tempest-VolumesSnapshotsTestJSON-2062503638 tempest-VolumesSnapshotsTestJSON-2062503638-project] Calling method '.version_select at 0x7f5f88e0daf0>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:22.328875 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-b05e0bb6-fca5-4d4d-8439-b12fa04a043d tempest-VolumesSnapshotsTestJSON-2062503638 tempest-VolumesSnapshotsTestJSON-2062503638-project] 10.222.0.85 "GET /compute/v2.1/os-snapshots/dee0d035-8f6e-4d7d-a724-bce160bd4750" status: 200 len: 287 microversion: 2.1 time: 0.069273 Jun 07 14:39:22.335219 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 12/16] 10.222.0.85 () {58 vars in 1250 bytes} [Tue Jun 7 14:39:22 2022] GET /compute/v2.1/os-snapshots/dee0d035-8f6e-4d7d-a724-bce160bd4750 => generated 287 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 14:39:22.566142 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-69cb0bd7-d7f7-43cc-b7bd-3fd0a28052a5 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd800b8efe792477bac3ca063920a4a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd7cee3f5704d01ae9df6d300b30004', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:39:22.584937 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-69cb0bd7-d7f7-43cc-b7bd-3fd0a28052a5 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] 10.222.0.85 "GET /compute/v2.1/servers/af1af1be-6244-4c4f-ac6a-918ace6e2f1d" status: 200 len: 1219 microversion: 2.1 time: 0.469561 Jun 07 14:39:22.585832 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 5/17] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:39:22 2022] GET /compute/v2.1/servers/af1af1be-6244-4c4f-ac6a-918ace6e2f1d => generated 1219 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:39:23.343125 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-b31e8d6e-efa7-4964-9086-6f073622e317 tempest-VolumesSnapshotsTestJSON-2062503638 tempest-VolumesSnapshotsTestJSON-2062503638-project] Calling method '.version_select at 0x7f5f88e0d9d0>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:23.438833 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-b31e8d6e-efa7-4964-9086-6f073622e317 tempest-VolumesSnapshotsTestJSON-2062503638 tempest-VolumesSnapshotsTestJSON-2062503638-project] 10.222.0.85 "GET /compute/v2.1/os-snapshots/dee0d035-8f6e-4d7d-a724-bce160bd4750" status: 200 len: 287 microversion: 2.1 time: 0.100192 Jun 07 14:39:23.439347 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 13/18] 10.222.0.85 () {58 vars in 1250 bytes} [Tue Jun 7 14:39:23 2022] GET /compute/v2.1/os-snapshots/dee0d035-8f6e-4d7d-a724-bce160bd4750 => generated 287 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:39:23.605317 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-284a22cc-1139-4f81-9339-c61e74203c2f tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:23.605951 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-284a22cc-1139-4f81-9339-c61e74203c2f tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] [instance: af1af1be-6244-4c4f-ac6a-918ace6e2f1d] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:39:23.613394 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-284a22cc-1139-4f81-9339-c61e74203c2f tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:23.613850 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-284a22cc-1139-4f81-9339-c61e74203c2f tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:23.614621 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-284a22cc-1139-4f81-9339-c61e74203c2f tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:23.615061 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-284a22cc-1139-4f81-9339-c61e74203c2f tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:23.736311 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-284a22cc-1139-4f81-9339-c61e74203c2f tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd800b8efe792477bac3ca063920a4a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd7cee3f5704d01ae9df6d300b30004', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:39:23.746055 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-284a22cc-1139-4f81-9339-c61e74203c2f tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] 10.222.0.85 "GET /compute/v2.1/servers/af1af1be-6244-4c4f-ac6a-918ace6e2f1d" status: 200 len: 1219 microversion: 2.1 time: 0.145055 Jun 07 14:39:23.762619 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 6/19] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:39:23 2022] GET /compute/v2.1/servers/af1af1be-6244-4c4f-ac6a-918ace6e2f1d => generated 1219 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:39:24.450227 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-04b2d573-b65c-4bb4-ae6c-ec790fda85e1 tempest-VolumesSnapshotsTestJSON-2062503638 tempest-VolumesSnapshotsTestJSON-2062503638-project] Calling method '.version_select at 0x7f5f88e0d0d0>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:24.519714 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-04b2d573-b65c-4bb4-ae6c-ec790fda85e1 tempest-VolumesSnapshotsTestJSON-2062503638 tempest-VolumesSnapshotsTestJSON-2062503638-project] 10.222.0.85 "GET /compute/v2.1/os-snapshots/dee0d035-8f6e-4d7d-a724-bce160bd4750" status: 200 len: 288 microversion: 2.1 time: 0.073733 Jun 07 14:39:24.534558 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 14/20] 10.222.0.85 () {58 vars in 1250 bytes} [Tue Jun 7 14:39:24 2022] GET /compute/v2.1/os-snapshots/dee0d035-8f6e-4d7d-a724-bce160bd4750 => generated 288 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:39:24.537167 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-df83c9d2-2d19-482c-a17a-62fe94736386 tempest-VolumesSnapshotsTestJSON-2062503638 tempest-VolumesSnapshotsTestJSON-2062503638-project] Calling method '.version_select at 0x7f5f88529280>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:24.766847 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-26f60480-0925-4624-a59d-40e85daed60f tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:24.768232 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-26f60480-0925-4624-a59d-40e85daed60f tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] [instance: af1af1be-6244-4c4f-ac6a-918ace6e2f1d] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:39:24.816054 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-26f60480-0925-4624-a59d-40e85daed60f tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:24.816799 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-26f60480-0925-4624-a59d-40e85daed60f tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:24.818898 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-26f60480-0925-4624-a59d-40e85daed60f tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:24.821365 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-26f60480-0925-4624-a59d-40e85daed60f tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:24.884304 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-df83c9d2-2d19-482c-a17a-62fe94736386 tempest-VolumesSnapshotsTestJSON-2062503638 tempest-VolumesSnapshotsTestJSON-2062503638-project] 10.222.0.85 "DELETE /compute/v2.1/os-snapshots/dee0d035-8f6e-4d7d-a724-bce160bd4750" status: 202 len: 0 microversion: 2.1 time: 0.356239 Jun 07 14:39:24.884935 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 7/21] 10.222.0.85 () {58 vars in 1253 bytes} [Tue Jun 7 14:39:24 2022] DELETE /compute/v2.1/os-snapshots/dee0d035-8f6e-4d7d-a724-bce160bd4750 => generated 0 bytes in 358 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 14:39:24.894162 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-46e919c1-bf28-4e3e-be47-15472c90471b tempest-VolumesSnapshotsTestJSON-2062503638 tempest-VolumesSnapshotsTestJSON-2062503638-project] Calling method '.version_select at 0x7f5f883f04c0>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:24.972607 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-46e919c1-bf28-4e3e-be47-15472c90471b tempest-VolumesSnapshotsTestJSON-2062503638 tempest-VolumesSnapshotsTestJSON-2062503638-project] 10.222.0.85 "GET /compute/v2.1/os-snapshots/dee0d035-8f6e-4d7d-a724-bce160bd4750" status: 200 len: 287 microversion: 2.1 time: 0.083116 Jun 07 14:39:24.973913 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 8/22] 10.222.0.85 () {58 vars in 1250 bytes} [Tue Jun 7 14:39:24 2022] GET /compute/v2.1/os-snapshots/dee0d035-8f6e-4d7d-a724-bce160bd4750 => generated 287 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 14:39:25.184156 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-26f60480-0925-4624-a59d-40e85daed60f tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd800b8efe792477bac3ca063920a4a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd7cee3f5704d01ae9df6d300b30004', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:39:25.216119 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-26f60480-0925-4624-a59d-40e85daed60f tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] 10.222.0.85 "GET /compute/v2.1/servers/af1af1be-6244-4c4f-ac6a-918ace6e2f1d" status: 200 len: 1267 microversion: 2.1 time: 0.454870 Jun 07 14:39:25.217041 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 15/23] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:39:24 2022] GET /compute/v2.1/servers/af1af1be-6244-4c4f-ac6a-918ace6e2f1d => generated 1267 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:39:25.464888 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-cd5ac672-4c67-49c6-9676-d8e0768660f9 tempest-VolumesTestJSON-1217626432 tempest-VolumesTestJSON-1217626432-project] Calling method '.version_select at 0x7f5f883f0b80>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:25.627785 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-cd5ac672-4c67-49c6-9676-d8e0768660f9 tempest-VolumesTestJSON-1217626432 tempest-VolumesTestJSON-1217626432-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/9fdb7528-24c0-4f5c-aa39-e21cbf65e88a" status: 200 len: 350 microversion: 2.1 time: 0.166755 Jun 07 14:39:25.629001 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 9/24] 10.222.0.85 () {58 vars in 1244 bytes} [Tue Jun 7 14:39:25 2022] GET /compute/v2.1/os-volumes/9fdb7528-24c0-4f5c-aa39-e21cbf65e88a => generated 350 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:39:25.986932 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-cbd5c142-e26e-465c-8167-a92d0aaf5a46 tempest-VolumesSnapshotsTestJSON-2062503638 tempest-VolumesSnapshotsTestJSON-2062503638-project] Calling method '.version_select at 0x7f5f883fe160>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:26.067035 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.wsgi [None req-cbd5c142-e26e-465c-8167-a92d0aaf5a46 tempest-VolumesSnapshotsTestJSON-2062503638 tempest-VolumesSnapshotsTestJSON-2062503638-project] HTTP exception thrown: Snapshot dee0d035-8f6e-4d7d-a724-bce160bd4750 could not be found. Jun 07 14:39:26.071376 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-cbd5c142-e26e-465c-8167-a92d0aaf5a46 tempest-VolumesSnapshotsTestJSON-2062503638 tempest-VolumesSnapshotsTestJSON-2062503638-project] Request method failure captured: Jun 07 14:39:26.071376 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: request: GET /compute/v2.1/os-snapshots/dee0d035-8f6e-4d7d-a724-bce160bd4750 HTTP/1.1 Jun 07 14:39:26.071376 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Accept: application/json Jun 07 14:39:26.071376 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Accept-Encoding: identity Jun 07 14:39:26.071376 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Connection: close Jun 07 14:39:26.071376 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Content-Length: 0 Jun 07 14:39:26.071376 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Content-Type: application/json Jun 07 14:39:26.071376 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Host: 10.222.0.85 Jun 07 14:39:26.071376 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Openstack-System-Scope: None Jun 07 14:39:26.071376 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: User-Agent: python-urllib3/1.26.9 Jun 07 14:39:26.071376 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Auth-Token: gAAAAABin2MP1T1thDzs4z61d69g028WgrABLLfqLMmefamGr7onLYEQfdbTVfQ2t5BHwMDhBlTXnv4irF2x5_QW0t8pOG5MiGpwjTvINz9EA6vLP8k9Jspa7cipIhx3G--VzH-m11SymIEBz-0lp18ly7Ud7Gig9dTRm2kEmV-Hv_VeGSL3q9w Jun 07 14:39:26.071376 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Domain-Id: None Jun 07 14:39:26.071376 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Domain-Name: None Jun 07 14:39:26.071376 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Identity-Status: Confirmed Jun 07 14:39:26.071376 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Is-Admin-Project: True Jun 07 14:39:26.071376 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Project-Domain-Id: default Jun 07 14:39:26.071376 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Project-Domain-Name: Default Jun 07 14:39:26.071376 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Project-Id: 01ea22e1fb6c4f378f9ff4b59ae609dd Jun 07 14:39:26.071376 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2062503638 Jun 07 14:39:26.071376 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Role: member,reader Jun 07 14:39:26.071376 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Roles: member,reader Jun 07 14:39:26.072763 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/01ea22e1fb6c4f378f9ff4b59ae609dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_01ea22e1fb6c4f378f9ff4b59ae609dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/01ea22e1fb6c4f378f9ff4b59ae609dd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/01ea22e1fb6c4f378f9ff4b59ae609dd"}]}] Jun 07 14:39:26.072763 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2062503638 Jun 07 14:39:26.072763 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Tenant-Id: 01ea22e1fb6c4f378f9ff4b59ae609dd Jun 07 14:39:26.072763 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2062503638 Jun 07 14:39:26.072763 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User: tempest-VolumesSnapshotsTestJSON-2062503638-project Jun 07 14:39:26.072763 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User-Domain-Id: default Jun 07 14:39:26.072763 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User-Domain-Name: Default Jun 07 14:39:26.072763 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User-Id: cee40d2493384405996c822271013d23 Jun 07 14:39:26.072763 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2062503638-project Jun 07 14:39:26.072763 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: method: Jun 07 14:39:26.072763 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: exception: Snapshot dee0d035-8f6e-4d7d-a724-bce160bd4750 could not be found. Jun 07 14:39:26.072763 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: action_args: {'id': 'dee0d035-8f6e-4d7d-a724-bce160bd4750'} Jun 07 14:39:26.072763 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:39:26.073539 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:39:26.073539 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 07 14:39:26.073539 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 07 14:39:26.073539 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 07 14:39:26.073539 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 07 14:39:26.073539 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 07 14:39:26.073539 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 07 14:39:26.073539 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 07 14:39:26.073539 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 07 14:39:26.073539 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 07 14:39:26.073539 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 07 14:39:26.073539 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 14:39:26.073539 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 14:39:26.073539 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 14:39:26.073539 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 14:39:26.073539 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot dee0d035-8f6e-4d7d-a724-bce160bd4750 could not be found. (HTTP 404) (Request-ID: req-d3bbb439-c17f-462f-928c-594999dc43a6) Jun 07 14:39:26.073539 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:39:26.073539 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:39:26.074580 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:39:26.074580 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:39:26.074580 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 07 14:39:26.074580 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 07 14:39:26.074580 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 07 14:39:26.074580 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 07 14:39:26.074580 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 07 14:39:26.074580 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 07 14:39:26.074580 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 07 14:39:26.074580 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 07 14:39:26.074580 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 07 14:39:26.074580 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 07 14:39:26.074580 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 07 14:39:26.074580 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 07 14:39:26.074580 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 07 14:39:26.074580 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 07 14:39:26.074580 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 07 14:39:26.074580 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 07 14:39:26.074580 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 07 14:39:26.075684 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 07 14:39:26.075684 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 14:39:26.075684 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 14:39:26.075684 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 14:39:26.075684 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 14:39:26.075684 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot dee0d035-8f6e-4d7d-a724-bce160bd4750 could not be found. Jun 07 14:39:26.075684 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:39:26.075684 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:39:26.075684 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:39:26.075684 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:39:26.075684 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:39:26.075684 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:39:26.075684 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:39:26.075684 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:39:26.075684 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 14:39:26.075684 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 14:39:26.075684 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:39:26.075684 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:39:26.075684 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 07 14:39:26.075684 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:39:26.077359 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot dee0d035-8f6e-4d7d-a724-bce160bd4750 could not be found. Jun 07 14:39:26.077359 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:39:26.077359 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:39:26.077359 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:39:26.077359 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:39:26.077359 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:39:26.077359 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:39:26.077359 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:39:26.077359 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:39:26.077359 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot dee0d035-8f6e-4d7d-a724-bce160bd4750 could not be found. Jun 07 14:39:26.077359 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:39:26.077359 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-cbd5c142-e26e-465c-8167-a92d0aaf5a46 tempest-VolumesSnapshotsTestJSON-2062503638 tempest-VolumesSnapshotsTestJSON-2062503638-project] Returning 404 to user: Snapshot dee0d035-8f6e-4d7d-a724-bce160bd4750 could not be found. {{(pid=118157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:39:26.077359 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-cbd5c142-e26e-465c-8167-a92d0aaf5a46 tempest-VolumesSnapshotsTestJSON-2062503638 tempest-VolumesSnapshotsTestJSON-2062503638-project] 10.222.0.85 "GET /compute/v2.1/os-snapshots/dee0d035-8f6e-4d7d-a724-bce160bd4750" status: 404 len: 111 microversion: 2.1 time: 0.093774 Jun 07 14:39:26.083614 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 10/25] 10.222.0.85 () {58 vars in 1250 bytes} [Tue Jun 7 14:39:25 2022] GET /compute/v2.1/os-snapshots/dee0d035-8f6e-4d7d-a724-bce160bd4750 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 14:39:26.094320 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-0fc20b1e-1bb5-40fc-b44f-2adfc15541fe tempest-VolumesSnapshotsTestJSON-2062503638 tempest-VolumesSnapshotsTestJSON-2062503638-project] Calling method '.version_select at 0x7f5f883fec10>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:26.604513 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-0fc20b1e-1bb5-40fc-b44f-2adfc15541fe tempest-VolumesSnapshotsTestJSON-2062503638 tempest-VolumesSnapshotsTestJSON-2062503638-project] 10.222.0.85 "DELETE /compute/v2.1/os-volumes/e46038e4-d7dd-4b88-8019-fe25a6b8ce0d" status: 202 len: 0 microversion: 2.1 time: 0.519702 Jun 07 14:39:26.605253 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 11/26] 10.222.0.85 () {58 vars in 1247 bytes} [Tue Jun 7 14:39:26 2022] DELETE /compute/v2.1/os-volumes/e46038e4-d7dd-4b88-8019-fe25a6b8ce0d => generated 0 bytes in 521 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 14:39:26.613076 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-415806e5-9f7c-4949-9762-cbbbeb853e42 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:26.614848 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-415806e5-9f7c-4949-9762-cbbbeb853e42 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] [instance: af1af1be-6244-4c4f-ac6a-918ace6e2f1d] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:39:26.644024 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-415806e5-9f7c-4949-9762-cbbbeb853e42 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:26.644500 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-415806e5-9f7c-4949-9762-cbbbeb853e42 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:26.645290 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-415806e5-9f7c-4949-9762-cbbbeb853e42 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:26.645805 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-415806e5-9f7c-4949-9762-cbbbeb853e42 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:26.754312 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-788710a1-de86-4c38-b28d-6e01c6e50cfe tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Action: 'create', calling method: .version_select at 0x7f5f88cea940>, body: {"keypair": {"name": "tempest-keypair-1077111204", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEUKfL7D1jC7RmD/fdWYvmU6CZdoUGIRY09DburqVVyYcdHxeyr9+7FfaG5EaHNjDM242WFveg5ppYTnNvw+VMH6mjeNbhD8ZE8bv1XuhQzznQADknunIEUGnTCoTmMUtw=="}} {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:39:26.969910 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.quota [None req-788710a1-de86-4c38-b28d-6e01c6e50cfe tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Getting quotas for project 97ba26b86c7243dab8e6c6b84ed674e8. Resources: {'key_pairs'} {{(pid=118158) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 14:39:26.994378 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.quota [None req-788710a1-de86-4c38-b28d-6e01c6e50cfe tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Getting quotas for user 4fb4b0cf5f8b4274b787f327793964f3 and project 97ba26b86c7243dab8e6c6b84ed674e8. Resources: {'key_pairs'} {{(pid=118158) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 14:39:27.247505 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-788710a1-de86-4c38-b28d-6e01c6e50cfe tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.287999 Jun 07 14:39:27.248317 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 16/27] 10.222.0.85 () {60 vars in 1158 bytes} [Tue Jun 7 14:39:25 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:39:27.258981 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-50225a63-714e-433f-85d9-7abee2187b50 tempest-VolumesSnapshotsTestJSON-2062503638 tempest-VolumesSnapshotsTestJSON-2062503638-project] Calling method '.version_select at 0x7f5f88c80700>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:27.284032 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG dbcounter [-] [118157] Writing DB stats nova_cell0:SELECT=2 {{(pid=118157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:39:27.306094 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.wsgi [None req-50225a63-714e-433f-85d9-7abee2187b50 tempest-VolumesSnapshotsTestJSON-2062503638 tempest-VolumesSnapshotsTestJSON-2062503638-project] HTTP exception thrown: Volume e46038e4-d7dd-4b88-8019-fe25a6b8ce0d could not be found. Jun 07 14:39:27.311279 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-50225a63-714e-433f-85d9-7abee2187b50 tempest-VolumesSnapshotsTestJSON-2062503638 tempest-VolumesSnapshotsTestJSON-2062503638-project] Request method failure captured: Jun 07 14:39:27.311279 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: request: GET /compute/v2.1/os-volumes/e46038e4-d7dd-4b88-8019-fe25a6b8ce0d HTTP/1.1 Jun 07 14:39:27.311279 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Accept: application/json Jun 07 14:39:27.311279 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Accept-Encoding: identity Jun 07 14:39:27.311279 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Connection: close Jun 07 14:39:27.311279 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Content-Length: 0 Jun 07 14:39:27.311279 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Content-Type: application/json Jun 07 14:39:27.311279 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Host: 10.222.0.85 Jun 07 14:39:27.311279 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Openstack-System-Scope: None Jun 07 14:39:27.311279 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: User-Agent: python-urllib3/1.26.9 Jun 07 14:39:27.311279 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Auth-Token: gAAAAABin2MP1T1thDzs4z61d69g028WgrABLLfqLMmefamGr7onLYEQfdbTVfQ2t5BHwMDhBlTXnv4irF2x5_QW0t8pOG5MiGpwjTvINz9EA6vLP8k9Jspa7cipIhx3G--VzH-m11SymIEBz-0lp18ly7Ud7Gig9dTRm2kEmV-Hv_VeGSL3q9w Jun 07 14:39:27.311279 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Domain-Id: None Jun 07 14:39:27.311279 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Domain-Name: None Jun 07 14:39:27.311279 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Identity-Status: Confirmed Jun 07 14:39:27.311279 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Is-Admin-Project: True Jun 07 14:39:27.311279 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Domain-Id: default Jun 07 14:39:27.311279 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Domain-Name: Default Jun 07 14:39:27.311279 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Id: 01ea22e1fb6c4f378f9ff4b59ae609dd Jun 07 14:39:27.311279 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2062503638 Jun 07 14:39:27.311279 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Role: member,reader Jun 07 14:39:27.311279 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Roles: member,reader Jun 07 14:39:27.312656 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/01ea22e1fb6c4f378f9ff4b59ae609dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_01ea22e1fb6c4f378f9ff4b59ae609dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/01ea22e1fb6c4f378f9ff4b59ae609dd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/01ea22e1fb6c4f378f9ff4b59ae609dd"}]}] Jun 07 14:39:27.312656 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2062503638 Jun 07 14:39:27.312656 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Tenant-Id: 01ea22e1fb6c4f378f9ff4b59ae609dd Jun 07 14:39:27.312656 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2062503638 Jun 07 14:39:27.312656 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User: tempest-VolumesSnapshotsTestJSON-2062503638-project Jun 07 14:39:27.312656 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Domain-Id: default Jun 07 14:39:27.312656 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Domain-Name: Default Jun 07 14:39:27.312656 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Id: cee40d2493384405996c822271013d23 Jun 07 14:39:27.312656 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2062503638-project Jun 07 14:39:27.312656 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: method: Jun 07 14:39:27.312656 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: exception: Volume e46038e4-d7dd-4b88-8019-fe25a6b8ce0d could not be found. Jun 07 14:39:27.312656 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: action_args: {'id': 'e46038e4-d7dd-4b88-8019-fe25a6b8ce0d'} Jun 07 14:39:27.312656 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:39:27.313608 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:39:27.313608 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 14:39:27.313608 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 14:39:27.313608 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 07 14:39:27.313608 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 07 14:39:27.313608 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 07 14:39:27.313608 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 07 14:39:27.313608 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 07 14:39:27.313608 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 07 14:39:27.313608 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 07 14:39:27.313608 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 07 14:39:27.313608 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 14:39:27.313608 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 14:39:27.313608 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 14:39:27.313608 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 14:39:27.313608 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e46038e4-d7dd-4b88-8019-fe25a6b8ce0d could not be found. (HTTP 404) (Request-ID: req-7d6276ae-ed51-499e-bcf1-af14d36acf68) Jun 07 14:39:27.313608 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:39:27.313608 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:39:27.313608 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:39:27.314699 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:39:27.314699 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 07 14:39:27.314699 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 07 14:39:27.314699 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 07 14:39:27.314699 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 07 14:39:27.314699 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 07 14:39:27.314699 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 07 14:39:27.314699 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 07 14:39:27.314699 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 07 14:39:27.314699 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 14:39:27.314699 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 14:39:27.314699 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 07 14:39:27.314699 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 07 14:39:27.314699 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 07 14:39:27.314699 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 07 14:39:27.314699 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 07 14:39:27.314699 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 07 14:39:27.314699 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 07 14:39:27.314699 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 07 14:39:27.315786 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 14:39:27.315786 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 14:39:27.315786 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 14:39:27.315786 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 14:39:27.315786 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e46038e4-d7dd-4b88-8019-fe25a6b8ce0d could not be found. Jun 07 14:39:27.315786 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:39:27.315786 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:39:27.315786 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:39:27.315786 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:39:27.315786 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:39:27.315786 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:39:27.315786 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:39:27.315786 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:39:27.315786 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 14:39:27.315786 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 14:39:27.315786 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:39:27.315786 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:39:27.315786 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 07 14:39:27.315786 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:39:27.316895 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e46038e4-d7dd-4b88-8019-fe25a6b8ce0d could not be found. Jun 07 14:39:27.316895 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:39:27.316895 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:39:27.316895 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:39:27.316895 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:39:27.316895 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:39:27.316895 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:39:27.316895 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:39:27.316895 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:39:27.316895 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e46038e4-d7dd-4b88-8019-fe25a6b8ce0d could not be found. Jun 07 14:39:27.316895 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:39:27.316895 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-50225a63-714e-433f-85d9-7abee2187b50 tempest-VolumesSnapshotsTestJSON-2062503638 tempest-VolumesSnapshotsTestJSON-2062503638-project] Returning 404 to user: Volume e46038e4-d7dd-4b88-8019-fe25a6b8ce0d could not be found. {{(pid=118158) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:39:27.321225 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-415806e5-9f7c-4949-9762-cbbbeb853e42 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd800b8efe792477bac3ca063920a4a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd7cee3f5704d01ae9df6d300b30004', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:39:27.326265 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-50225a63-714e-433f-85d9-7abee2187b50 tempest-VolumesSnapshotsTestJSON-2062503638 tempest-VolumesSnapshotsTestJSON-2062503638-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/e46038e4-d7dd-4b88-8019-fe25a6b8ce0d" status: 404 len: 109 microversion: 2.1 time: 0.065739 Jun 07 14:39:27.332687 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 17/28] 10.222.0.85 () {58 vars in 1244 bytes} [Tue Jun 7 14:39:27 2022] GET /compute/v2.1/os-volumes/e46038e4-d7dd-4b88-8019-fe25a6b8ce0d => generated 109 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 14:39:27.333732 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-415806e5-9f7c-4949-9762-cbbbeb853e42 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] 10.222.0.85 "GET /compute/v2.1/servers/af1af1be-6244-4c4f-ac6a-918ace6e2f1d" status: 200 len: 1273 microversion: 2.1 time: 0.726983 Jun 07 14:39:27.335676 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 12/29] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:39:26 2022] GET /compute/v2.1/servers/af1af1be-6244-4c4f-ac6a-918ace6e2f1d => generated 1273 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:39:27.347699 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-b7e1d898-9a55-4786-91df-396bf84d6a41 tempest-VolumesSnapshotsTestJSON-2062503638 tempest-VolumesSnapshotsTestJSON-2062503638-project] Calling method '.version_select at 0x7f5f883e4af0>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:27.406117 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.wsgi [None req-b7e1d898-9a55-4786-91df-396bf84d6a41 tempest-VolumesSnapshotsTestJSON-2062503638 tempest-VolumesSnapshotsTestJSON-2062503638-project] HTTP exception thrown: Volume e46038e4-d7dd-4b88-8019-fe25a6b8ce0d could not be found. Jun 07 14:39:27.408158 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-b7e1d898-9a55-4786-91df-396bf84d6a41 tempest-VolumesSnapshotsTestJSON-2062503638 tempest-VolumesSnapshotsTestJSON-2062503638-project] Request method failure captured: Jun 07 14:39:27.408158 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: request: DELETE /compute/v2.1/os-volumes/e46038e4-d7dd-4b88-8019-fe25a6b8ce0d HTTP/1.1 Jun 07 14:39:27.408158 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Accept: application/json Jun 07 14:39:27.408158 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Accept-Encoding: identity Jun 07 14:39:27.408158 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Connection: close Jun 07 14:39:27.408158 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Content-Length: 0 Jun 07 14:39:27.408158 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Content-Type: application/json Jun 07 14:39:27.408158 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Host: 10.222.0.85 Jun 07 14:39:27.408158 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Openstack-System-Scope: None Jun 07 14:39:27.408158 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: User-Agent: python-urllib3/1.26.9 Jun 07 14:39:27.408158 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Auth-Token: gAAAAABin2MP1T1thDzs4z61d69g028WgrABLLfqLMmefamGr7onLYEQfdbTVfQ2t5BHwMDhBlTXnv4irF2x5_QW0t8pOG5MiGpwjTvINz9EA6vLP8k9Jspa7cipIhx3G--VzH-m11SymIEBz-0lp18ly7Ud7Gig9dTRm2kEmV-Hv_VeGSL3q9w Jun 07 14:39:27.408158 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Domain-Id: None Jun 07 14:39:27.408158 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Domain-Name: None Jun 07 14:39:27.408158 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Identity-Status: Confirmed Jun 07 14:39:27.408158 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Is-Admin-Project: True Jun 07 14:39:27.408158 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Domain-Id: default Jun 07 14:39:27.408158 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Domain-Name: Default Jun 07 14:39:27.408158 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Id: 01ea22e1fb6c4f378f9ff4b59ae609dd Jun 07 14:39:27.408158 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2062503638 Jun 07 14:39:27.408158 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Role: member,reader Jun 07 14:39:27.408158 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Roles: member,reader Jun 07 14:39:27.409242 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/01ea22e1fb6c4f378f9ff4b59ae609dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_01ea22e1fb6c4f378f9ff4b59ae609dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/01ea22e1fb6c4f378f9ff4b59ae609dd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/01ea22e1fb6c4f378f9ff4b59ae609dd"}]}] Jun 07 14:39:27.409242 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2062503638 Jun 07 14:39:27.409242 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Tenant-Id: 01ea22e1fb6c4f378f9ff4b59ae609dd Jun 07 14:39:27.409242 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2062503638 Jun 07 14:39:27.409242 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User: tempest-VolumesSnapshotsTestJSON-2062503638-project Jun 07 14:39:27.409242 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Domain-Id: default Jun 07 14:39:27.409242 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Domain-Name: Default Jun 07 14:39:27.409242 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Id: cee40d2493384405996c822271013d23 Jun 07 14:39:27.409242 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2062503638-project Jun 07 14:39:27.409242 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: method: Jun 07 14:39:27.409242 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: exception: Volume e46038e4-d7dd-4b88-8019-fe25a6b8ce0d could not be found. Jun 07 14:39:27.409242 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: action_args: {'id': 'e46038e4-d7dd-4b88-8019-fe25a6b8ce0d'} Jun 07 14:39:27.409242 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:39:27.409837 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:39:27.409837 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 14:39:27.409837 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 14:39:27.409837 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 07 14:39:27.409837 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 07 14:39:27.409837 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 07 14:39:27.409837 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 07 14:39:27.409837 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 07 14:39:27.409837 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 07 14:39:27.409837 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 07 14:39:27.409837 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 07 14:39:27.409837 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 14:39:27.409837 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 14:39:27.409837 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 14:39:27.409837 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 14:39:27.409837 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e46038e4-d7dd-4b88-8019-fe25a6b8ce0d could not be found. (HTTP 404) (Request-ID: req-e10aacec-8d73-406b-8a9f-b62301de55ad) Jun 07 14:39:27.409837 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:39:27.409837 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:39:27.409837 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:39:27.410682 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:39:27.410682 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 07 14:39:27.410682 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 07 14:39:27.410682 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 07 14:39:27.410682 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 07 14:39:27.410682 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 07 14:39:27.410682 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 07 14:39:27.410682 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 07 14:39:27.410682 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 07 14:39:27.410682 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 14:39:27.410682 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 14:39:27.410682 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 07 14:39:27.410682 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 07 14:39:27.410682 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 07 14:39:27.410682 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 07 14:39:27.410682 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 07 14:39:27.410682 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 07 14:39:27.410682 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 07 14:39:27.410682 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 07 14:39:27.411545 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 14:39:27.411545 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 14:39:27.411545 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 14:39:27.411545 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 14:39:27.411545 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e46038e4-d7dd-4b88-8019-fe25a6b8ce0d could not be found. Jun 07 14:39:27.411545 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:39:27.411545 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:39:27.411545 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:39:27.411545 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:39:27.411545 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:39:27.411545 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:39:27.411545 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:39:27.411545 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:39:27.411545 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 14:39:27.411545 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 14:39:27.411545 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:39:27.411545 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:39:27.411545 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 07 14:39:27.411545 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:39:27.412402 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e46038e4-d7dd-4b88-8019-fe25a6b8ce0d could not be found. Jun 07 14:39:27.412402 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:39:27.412402 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:39:27.412402 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:39:27.412402 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:39:27.412402 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:39:27.412402 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:39:27.412402 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:39:27.412402 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:39:27.412402 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e46038e4-d7dd-4b88-8019-fe25a6b8ce0d could not be found. Jun 07 14:39:27.412402 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:39:27.414803 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-b7e1d898-9a55-4786-91df-396bf84d6a41 tempest-VolumesSnapshotsTestJSON-2062503638 tempest-VolumesSnapshotsTestJSON-2062503638-project] Returning 404 to user: Volume e46038e4-d7dd-4b88-8019-fe25a6b8ce0d could not be found. {{(pid=118158) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:39:27.415858 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-b7e1d898-9a55-4786-91df-396bf84d6a41 tempest-VolumesSnapshotsTestJSON-2062503638 tempest-VolumesSnapshotsTestJSON-2062503638-project] 10.222.0.85 "DELETE /compute/v2.1/os-volumes/e46038e4-d7dd-4b88-8019-fe25a6b8ce0d" status: 404 len: 109 microversion: 2.1 time: 0.072666 Jun 07 14:39:27.416826 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 18/30] 10.222.0.85 () {58 vars in 1247 bytes} [Tue Jun 7 14:39:27 2022] DELETE /compute/v2.1/os-volumes/e46038e4-d7dd-4b88-8019-fe25a6b8ce0d => generated 109 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 14:39:27.426122 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-73a78081-e5f7-480b-8dfc-5a025e60a396 tempest-VolumesSnapshotsTestJSON-2062503638 tempest-VolumesSnapshotsTestJSON-2062503638-project] Calling method '.version_select at 0x7f5f88371430>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:27.460821 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.wsgi [None req-73a78081-e5f7-480b-8dfc-5a025e60a396 tempest-VolumesSnapshotsTestJSON-2062503638 tempest-VolumesSnapshotsTestJSON-2062503638-project] HTTP exception thrown: Volume e46038e4-d7dd-4b88-8019-fe25a6b8ce0d could not be found. Jun 07 14:39:27.463326 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-73a78081-e5f7-480b-8dfc-5a025e60a396 tempest-VolumesSnapshotsTestJSON-2062503638 tempest-VolumesSnapshotsTestJSON-2062503638-project] Request method failure captured: Jun 07 14:39:27.463326 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: request: GET /compute/v2.1/os-volumes/e46038e4-d7dd-4b88-8019-fe25a6b8ce0d HTTP/1.1 Jun 07 14:39:27.463326 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Accept: application/json Jun 07 14:39:27.463326 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Accept-Encoding: identity Jun 07 14:39:27.463326 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Connection: close Jun 07 14:39:27.463326 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Content-Length: 0 Jun 07 14:39:27.463326 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Content-Type: application/json Jun 07 14:39:27.463326 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Host: 10.222.0.85 Jun 07 14:39:27.463326 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Openstack-System-Scope: None Jun 07 14:39:27.463326 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: User-Agent: python-urllib3/1.26.9 Jun 07 14:39:27.463326 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Auth-Token: gAAAAABin2MP1T1thDzs4z61d69g028WgrABLLfqLMmefamGr7onLYEQfdbTVfQ2t5BHwMDhBlTXnv4irF2x5_QW0t8pOG5MiGpwjTvINz9EA6vLP8k9Jspa7cipIhx3G--VzH-m11SymIEBz-0lp18ly7Ud7Gig9dTRm2kEmV-Hv_VeGSL3q9w Jun 07 14:39:27.463326 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Domain-Id: None Jun 07 14:39:27.463326 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Domain-Name: None Jun 07 14:39:27.463326 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Identity-Status: Confirmed Jun 07 14:39:27.463326 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Is-Admin-Project: True Jun 07 14:39:27.463326 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Project-Domain-Id: default Jun 07 14:39:27.463326 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Project-Domain-Name: Default Jun 07 14:39:27.463326 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Project-Id: 01ea22e1fb6c4f378f9ff4b59ae609dd Jun 07 14:39:27.463326 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2062503638 Jun 07 14:39:27.463326 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Role: member,reader Jun 07 14:39:27.463326 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Roles: member,reader Jun 07 14:39:27.465136 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/01ea22e1fb6c4f378f9ff4b59ae609dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_01ea22e1fb6c4f378f9ff4b59ae609dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/01ea22e1fb6c4f378f9ff4b59ae609dd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/01ea22e1fb6c4f378f9ff4b59ae609dd"}]}] Jun 07 14:39:27.465136 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2062503638 Jun 07 14:39:27.465136 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Tenant-Id: 01ea22e1fb6c4f378f9ff4b59ae609dd Jun 07 14:39:27.465136 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2062503638 Jun 07 14:39:27.465136 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User: tempest-VolumesSnapshotsTestJSON-2062503638-project Jun 07 14:39:27.465136 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User-Domain-Id: default Jun 07 14:39:27.465136 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User-Domain-Name: Default Jun 07 14:39:27.465136 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User-Id: cee40d2493384405996c822271013d23 Jun 07 14:39:27.465136 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2062503638-project Jun 07 14:39:27.465136 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: method: Jun 07 14:39:27.465136 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: exception: Volume e46038e4-d7dd-4b88-8019-fe25a6b8ce0d could not be found. Jun 07 14:39:27.465136 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: action_args: {'id': 'e46038e4-d7dd-4b88-8019-fe25a6b8ce0d'} Jun 07 14:39:27.465136 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:39:27.467199 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:39:27.467199 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 14:39:27.467199 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 14:39:27.467199 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 07 14:39:27.467199 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 07 14:39:27.467199 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 07 14:39:27.467199 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 07 14:39:27.467199 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 07 14:39:27.467199 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 07 14:39:27.467199 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 07 14:39:27.467199 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 07 14:39:27.467199 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 14:39:27.467199 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 14:39:27.467199 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 14:39:27.467199 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 14:39:27.467199 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e46038e4-d7dd-4b88-8019-fe25a6b8ce0d could not be found. (HTTP 404) (Request-ID: req-4c87e50d-5b45-4a21-a93b-78a1d93b0829) Jun 07 14:39:27.467199 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:39:27.467199 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:39:27.467199 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:39:27.474997 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:39:27.474997 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 07 14:39:27.474997 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 07 14:39:27.474997 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 07 14:39:27.474997 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 07 14:39:27.474997 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 07 14:39:27.474997 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 07 14:39:27.474997 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 07 14:39:27.474997 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 07 14:39:27.474997 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 14:39:27.474997 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 14:39:27.474997 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 07 14:39:27.474997 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 07 14:39:27.474997 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 07 14:39:27.474997 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 07 14:39:27.474997 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 07 14:39:27.474997 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 07 14:39:27.474997 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 07 14:39:27.474997 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 07 14:39:27.478444 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 14:39:27.478444 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 14:39:27.478444 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 14:39:27.478444 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 14:39:27.478444 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e46038e4-d7dd-4b88-8019-fe25a6b8ce0d could not be found. Jun 07 14:39:27.478444 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:39:27.478444 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:39:27.478444 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:39:27.478444 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:39:27.478444 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:39:27.478444 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:39:27.478444 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:39:27.478444 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:39:27.478444 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 14:39:27.478444 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 14:39:27.478444 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:39:27.478444 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:39:27.478444 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 07 14:39:27.478444 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:39:27.481757 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e46038e4-d7dd-4b88-8019-fe25a6b8ce0d could not be found. Jun 07 14:39:27.481757 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:39:27.481757 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:39:27.481757 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:39:27.481757 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:39:27.481757 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:39:27.481757 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:39:27.481757 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:39:27.481757 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:39:27.481757 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e46038e4-d7dd-4b88-8019-fe25a6b8ce0d could not be found. Jun 07 14:39:27.481757 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:39:27.481757 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-73a78081-e5f7-480b-8dfc-5a025e60a396 tempest-VolumesSnapshotsTestJSON-2062503638 tempest-VolumesSnapshotsTestJSON-2062503638-project] Returning 404 to user: Volume e46038e4-d7dd-4b88-8019-fe25a6b8ce0d could not be found. {{(pid=118157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:39:27.481757 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-73a78081-e5f7-480b-8dfc-5a025e60a396 tempest-VolumesSnapshotsTestJSON-2062503638 tempest-VolumesSnapshotsTestJSON-2062503638-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/e46038e4-d7dd-4b88-8019-fe25a6b8ce0d" status: 404 len: 109 microversion: 2.1 time: 0.046041 Jun 07 14:39:27.481757 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 13/31] 10.222.0.85 () {58 vars in 1244 bytes} [Tue Jun 7 14:39:27 2022] GET /compute/v2.1/os-volumes/e46038e4-d7dd-4b88-8019-fe25a6b8ce0d => generated 109 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 14:39:27.895739 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-698d2dc0-ea71-46f3-8776-3bd9c3d068a5 tempest-VolumesTestJSON-1217626432 tempest-VolumesTestJSON-1217626432-project] Calling method '.version_select at 0x7f5f88371940>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:27.974921 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-698d2dc0-ea71-46f3-8776-3bd9c3d068a5 tempest-VolumesTestJSON-1217626432 tempest-VolumesTestJSON-1217626432-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/b7ce57c5-7ee5-4950-86d0-2976337ab10c" status: 200 len: 351 microversion: 2.1 time: 0.083541 Jun 07 14:39:27.981937 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 14/32] 10.222.0.85 () {58 vars in 1244 bytes} [Tue Jun 7 14:39:27 2022] GET /compute/v2.1/os-volumes/b7ce57c5-7ee5-4950-86d0-2976337ab10c => generated 351 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:39:28.000633 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-8267443e-8704-4ff5-9480-4ebbb9d50873 tempest-VolumesTestJSON-1217626432 tempest-VolumesTestJSON-1217626432-project] Calling method '.version_select at 0x7f5f88363700>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:28.218911 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-8267443e-8704-4ff5-9480-4ebbb9d50873 tempest-VolumesTestJSON-1217626432 tempest-VolumesTestJSON-1217626432-project] 10.222.0.85 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.235257 Jun 07 14:39:28.226956 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 15/33] 10.222.0.85 () {58 vars in 1133 bytes} [Tue Jun 7 14:39:27 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:39:28.231809 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-37d5fdd1-f58a-48f0-ad3c-011b8151d83b tempest-VolumesTestJSON-1217626432 tempest-VolumesTestJSON-1217626432-project] Calling method '.version_select at 0x7f5f883fef70>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:28.450282 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-37d5fdd1-f58a-48f0-ad3c-011b8151d83b tempest-VolumesTestJSON-1217626432 tempest-VolumesTestJSON-1217626432-project] 10.222.0.85 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.222179 Jun 07 14:39:28.451989 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 16/34] 10.222.0.85 () {58 vars in 1148 bytes} [Tue Jun 7 14:39:28 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:39:28.465467 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-a13c71a9-991e-449e-8922-9a9768788ae9 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:28.466093 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-a13c71a9-991e-449e-8922-9a9768788ae9 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] [instance: af1af1be-6244-4c4f-ac6a-918ace6e2f1d] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:39:28.484993 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-a13c71a9-991e-449e-8922-9a9768788ae9 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:28.485446 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-a13c71a9-991e-449e-8922-9a9768788ae9 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:28.486243 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-a13c71a9-991e-449e-8922-9a9768788ae9 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:28.490955 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-a13c71a9-991e-449e-8922-9a9768788ae9 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:28.560837 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-11a12454-5736-4129-8203-4a64693cee81 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Action: 'create', calling method: .version_select at 0x7f5f883e4f70>, body: {"keypair": {"name": "tempest-keypair-785449831", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIq98HcGCMltDDclNO737DL0fTSVtRhI/MefIi5M2Er7irpDlOgP+WxPOiI3DbJw+xX8zEspQdO98HLiYce9RIpz2ops8WSYl2dh4G+ioMxffddp0j2OhEeK4P+V/xjzXA=="}} {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:39:28.590944 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.quota [None req-11a12454-5736-4129-8203-4a64693cee81 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Getting quotas for project 8eae64ee53144e4f8d583bb4288c0aeb. Resources: {'key_pairs'} {{(pid=118158) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 14:39:28.597629 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.quota [None req-11a12454-5736-4129-8203-4a64693cee81 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Getting quotas for user 34eb9ec1f3ff44bbb03cf934cb2a04de and project 8eae64ee53144e4f8d583bb4288c0aeb. Resources: {'key_pairs'} {{(pid=118158) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 14:39:28.764786 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-a13c71a9-991e-449e-8922-9a9768788ae9 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd800b8efe792477bac3ca063920a4a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd7cee3f5704d01ae9df6d300b30004', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:39:28.767197 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-11a12454-5736-4129-8203-4a64693cee81 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.900235 Jun 07 14:39:28.768028 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 19/35] 10.222.0.85 () {60 vars in 1158 bytes} [Tue Jun 7 14:39:27 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:39:28.773784 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-7964c3fb-b492-44b4-a050-275ab46db26b tempest-VolumesTestJSON-1217626432 tempest-VolumesTestJSON-1217626432-project] Calling method '.version_select at 0x7f5f88405310>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:28.792534 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-a13c71a9-991e-449e-8922-9a9768788ae9 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] 10.222.0.85 "GET /compute/v2.1/servers/af1af1be-6244-4c4f-ac6a-918ace6e2f1d" status: 200 len: 1315 microversion: 2.1 time: 0.330786 Jun 07 14:39:28.797116 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 17/36] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:39:28 2022] GET /compute/v2.1/servers/af1af1be-6244-4c4f-ac6a-918ace6e2f1d => generated 1315 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:39:29.070608 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-7964c3fb-b492-44b4-a050-275ab46db26b tempest-VolumesTestJSON-1217626432 tempest-VolumesTestJSON-1217626432-project] 10.222.0.85 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.301263 Jun 07 14:39:29.071454 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 20/37] 10.222.0.85 () {58 vars in 1133 bytes} [Tue Jun 7 14:39:28 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:39:29.083463 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-27978a65-49d6-4ff2-93cf-fa17c345e69d tempest-VolumesTestJSON-1217626432 tempest-VolumesTestJSON-1217626432-project] Calling method '.version_select at 0x7f5f88c970d0>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:29.320638 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-5f5c576d-8a53-4d5b-af42-f9e92f073b5e tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1934363502", "imageRef": "7802ce25-d370-43a3-8d85-0257d644d539", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:39:29.356675 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-27978a65-49d6-4ff2-93cf-fa17c345e69d tempest-VolumesTestJSON-1217626432 tempest-VolumesTestJSON-1217626432-project] 10.222.0.85 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.276915 Jun 07 14:39:29.357847 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 21/38] 10.222.0.85 () {58 vars in 1166 bytes} [Tue Jun 7 14:39:29 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:39:29.372279 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-30141a8f-7047-4de6-9235-8b81eb51229d tempest-VolumesTestJSON-1217626432 tempest-VolumesTestJSON-1217626432-project] Calling method '.version_select at 0x7f5f88e0dca0>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:29.473432 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.network.neutron [None req-5f5c576d-8a53-4d5b-af42-f9e92f073b5e tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] validate_networks() for [('fe436814-4d43-40f4-a910-26ab3da64594', None, None, None, None, None)] {{(pid=118157) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 14:39:29.620848 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-30141a8f-7047-4de6-9235-8b81eb51229d tempest-VolumesTestJSON-1217626432 tempest-VolumesTestJSON-1217626432-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.254609 Jun 07 14:39:29.664205 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 22/39] 10.222.0.85 () {58 vars in 1169 bytes} [Tue Jun 7 14:39:29 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:39:29.664205 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-6aacdefe-47f5-479b-ae9a-da4eb90114da tempest-VolumesTestJSON-1217626432 tempest-VolumesTestJSON-1217626432-project] Calling method '.version_select at 0x7f5f883e4f70>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:29.725888 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG dbcounter [-] [118157] Writing DB stats nova_cell0:SELECT=10 {{(pid=118157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:39:29.875894 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-6aacdefe-47f5-479b-ae9a-da4eb90114da tempest-VolumesTestJSON-1217626432 tempest-VolumesTestJSON-1217626432-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.242654 Jun 07 14:39:29.877090 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 23/40] 10.222.0.85 () {58 vars in 1154 bytes} [Tue Jun 7 14:39:29 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:39:29.882479 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-f6c7b449-8131-46f9-bc06-55dd80fae2bb tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:29.884792 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-f6c7b449-8131-46f9-bc06-55dd80fae2bb tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] [instance: af1af1be-6244-4c4f-ac6a-918ace6e2f1d] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:39:29.916464 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-f6c7b449-8131-46f9-bc06-55dd80fae2bb tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:29.919220 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-f6c7b449-8131-46f9-bc06-55dd80fae2bb tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:29.924505 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-f6c7b449-8131-46f9-bc06-55dd80fae2bb tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:29.926369 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-f6c7b449-8131-46f9-bc06-55dd80fae2bb tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:30.326357 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-f6c7b449-8131-46f9-bc06-55dd80fae2bb tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd800b8efe792477bac3ca063920a4a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd7cee3f5704d01ae9df6d300b30004', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:39:30.326357 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-f6c7b449-8131-46f9-bc06-55dd80fae2bb tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] 10.222.0.85 "GET /compute/v2.1/servers/af1af1be-6244-4c4f-ac6a-918ace6e2f1d" status: 200 len: 1315 microversion: 2.1 time: 0.406979 Jun 07 14:39:30.326357 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 24/41] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:39:29 2022] GET /compute/v2.1/servers/af1af1be-6244-4c4f-ac6a-918ace6e2f1d => generated 1315 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:39:30.326357 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-28c32dde-5941-488b-86dc-d01375314161 tempest-VolumesTestJSON-1217626432 tempest-VolumesTestJSON-1217626432-project] Calling method '.version_select at 0x7f5f883e4e50>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:30.467424 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-28c32dde-5941-488b-86dc-d01375314161 tempest-VolumesTestJSON-1217626432 tempest-VolumesTestJSON-1217626432-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.176182 Jun 07 14:39:30.469021 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 25/42] 10.222.0.85 () {58 vars in 1187 bytes} [Tue Jun 7 14:39:30 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:39:30.490372 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-bceab731-dd80-41e1-b63d-f851d445c13b tempest-VolumesTestJSON-1217626432 tempest-VolumesTestJSON-1217626432-project] Calling method '.version_select at 0x7f5f88c971f0>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:30.771059 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-bceab731-dd80-41e1-b63d-f851d445c13b tempest-VolumesTestJSON-1217626432 tempest-VolumesTestJSON-1217626432-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.288707 Jun 07 14:39:30.771740 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 26/43] 10.222.0.85 () {58 vars in 1154 bytes} [Tue Jun 7 14:39:30 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:39:31.336007 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-19336197-650b-4efa-9b35-9cc3e6a832a1 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:31.338931 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-19336197-650b-4efa-9b35-9cc3e6a832a1 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] [instance: af1af1be-6244-4c4f-ac6a-918ace6e2f1d] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:39:31.358143 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.virt.hardware [None req-5f5c576d-8a53-4d5b-af42-f9e92f073b5e tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Flavor limits 0:0:0 {{(pid=118157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 14:39:31.359178 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.virt.hardware [None req-5f5c576d-8a53-4d5b-af42-f9e92f073b5e tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Image limits 0:0:0 {{(pid=118157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 14:39:31.359502 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.virt.hardware [None req-5f5c576d-8a53-4d5b-af42-f9e92f073b5e tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Flavor pref 0:0:0 {{(pid=118157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 14:39:31.359912 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.virt.hardware [None req-5f5c576d-8a53-4d5b-af42-f9e92f073b5e tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Image pref 0:0:0 {{(pid=118157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 14:39:31.360329 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.virt.hardware [None req-5f5c576d-8a53-4d5b-af42-f9e92f073b5e tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 14:39:31.370171 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-19336197-650b-4efa-9b35-9cc3e6a832a1 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:31.380173 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-5f5c576d-8a53-4d5b-af42-f9e92f073b5e tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:31.380173 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-5f5c576d-8a53-4d5b-af42-f9e92f073b5e tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:31.381648 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-5f5c576d-8a53-4d5b-af42-f9e92f073b5e tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:31.382009 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-19336197-650b-4efa-9b35-9cc3e6a832a1 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:31.382126 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-5f5c576d-8a53-4d5b-af42-f9e92f073b5e tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:31.384600 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-19336197-650b-4efa-9b35-9cc3e6a832a1 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:31.388265 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-19336197-650b-4efa-9b35-9cc3e6a832a1 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:31.454119 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.quota [None req-5f5c576d-8a53-4d5b-af42-f9e92f073b5e tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Getting quotas for project e80aa19d008640df9a1f924a7c03f7f6. Resources: {'instances', 'cores', 'ram'} {{(pid=118157) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 14:39:31.472257 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.quota [None req-5f5c576d-8a53-4d5b-af42-f9e92f073b5e tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Getting quotas for user 48bbf88b32774d5da9ef93ac75686c34 and project e80aa19d008640df9a1f924a7c03f7f6. Resources: {'instances', 'cores', 'ram'} {{(pid=118157) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 14:39:31.518151 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-5f5c576d-8a53-4d5b-af42-f9e92f073b5e tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Going to run 1 instances... {{(pid=118157) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 14:39:31.524572 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-5f5c576d-8a53-4d5b-af42-f9e92f073b5e tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 45f65f98-e1ca-4e07-872a-ef0403e2d50a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7802ce25-d370-43a3-8d85-0257d644d539',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118157) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 14:39:31.861759 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-5f5c576d-8a53-4d5b-af42-f9e92f073b5e tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.017433 Jun 07 14:39:31.867105 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 18/44] 10.222.0.85 () {60 vars in 1146 bytes} [Tue Jun 7 14:39:28 2022] POST /compute/v2.1/servers => generated 383 bytes in 3029 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 07 14:39:31.937427 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-2f48dfe5-f75f-41ee-99f8-13917f5cd468 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:31.937427 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-2f48dfe5-f75f-41ee-99f8-13917f5cd468 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 45f65f98-e1ca-4e07-872a-ef0403e2d50a] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:39:32.293572 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-2f48dfe5-f75f-41ee-99f8-13917f5cd468 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:39:32.325348 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-2f48dfe5-f75f-41ee-99f8-13917f5cd468 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/45f65f98-e1ca-4e07-872a-ef0403e2d50a" status: 200 len: 1222 microversion: 2.1 time: 0.445886 Jun 07 14:39:32.344088 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-19336197-650b-4efa-9b35-9cc3e6a832a1 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd800b8efe792477bac3ca063920a4a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd7cee3f5704d01ae9df6d300b30004', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:39:32.345431 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 19/45] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:39:31 2022] GET /compute/v2.1/servers/45f65f98-e1ca-4e07-872a-ef0403e2d50a => generated 1222 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:39:32.353002 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-19336197-650b-4efa-9b35-9cc3e6a832a1 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] 10.222.0.85 "GET /compute/v2.1/servers/af1af1be-6244-4c4f-ac6a-918ace6e2f1d" status: 200 len: 1315 microversion: 2.1 time: 1.025439 Jun 07 14:39:32.372631 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 27/46] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:39:31 2022] GET /compute/v2.1/servers/af1af1be-6244-4c4f-ac6a-918ace6e2f1d => generated 1315 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:39:32.878489 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-76258a7f-48f9-4527-80e2-505689b10436 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-7732899", "imageRef": "7802ce25-d370-43a3-8d85-0257d644d539", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:39:32.992610 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.network.neutron [None req-76258a7f-48f9-4527-80e2-505689b10436 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] validate_networks() for [('fe436814-4d43-40f4-a910-26ab3da64594', None, None, None, None, None)] {{(pid=118157) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 14:39:33.376351 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-6137e7ad-a6cc-4a41-aa56-3df9f14fde05 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:33.377682 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-6137e7ad-a6cc-4a41-aa56-3df9f14fde05 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] [instance: af1af1be-6244-4c4f-ac6a-918ace6e2f1d] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:39:33.387490 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-6137e7ad-a6cc-4a41-aa56-3df9f14fde05 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:33.392060 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-6137e7ad-a6cc-4a41-aa56-3df9f14fde05 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:33.396102 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-6137e7ad-a6cc-4a41-aa56-3df9f14fde05 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:33.397073 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-6137e7ad-a6cc-4a41-aa56-3df9f14fde05 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:34.543926 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.virt.hardware [None req-76258a7f-48f9-4527-80e2-505689b10436 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Flavor limits 0:0:0 {{(pid=118157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 14:39:34.545018 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.virt.hardware [None req-76258a7f-48f9-4527-80e2-505689b10436 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Image limits 0:0:0 {{(pid=118157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 14:39:34.545730 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.virt.hardware [None req-76258a7f-48f9-4527-80e2-505689b10436 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Flavor pref 0:0:0 {{(pid=118157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 14:39:34.546523 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.virt.hardware [None req-76258a7f-48f9-4527-80e2-505689b10436 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Image pref 0:0:0 {{(pid=118157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 14:39:34.547180 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.virt.hardware [None req-76258a7f-48f9-4527-80e2-505689b10436 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 14:39:34.567462 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-76258a7f-48f9-4527-80e2-505689b10436 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:34.574714 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-76258a7f-48f9-4527-80e2-505689b10436 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:34.575078 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-76258a7f-48f9-4527-80e2-505689b10436 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:34.575824 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-76258a7f-48f9-4527-80e2-505689b10436 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:34.638282 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.quota [None req-76258a7f-48f9-4527-80e2-505689b10436 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Getting quotas for project e80aa19d008640df9a1f924a7c03f7f6. Resources: {'instances', 'cores', 'ram'} {{(pid=118157) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 14:39:34.647662 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.quota [None req-76258a7f-48f9-4527-80e2-505689b10436 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Getting quotas for user 48bbf88b32774d5da9ef93ac75686c34 and project e80aa19d008640df9a1f924a7c03f7f6. Resources: {'instances', 'cores', 'ram'} {{(pid=118157) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 14:39:34.680894 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-76258a7f-48f9-4527-80e2-505689b10436 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Going to run 1 instances... {{(pid=118157) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 14:39:34.689407 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-76258a7f-48f9-4527-80e2-505689b10436 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: ee2e782c-42ff-4093-9246-75d4e69929b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7802ce25-d370-43a3-8d85-0257d644d539',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118157) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 14:39:34.938096 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-76258a7f-48f9-4527-80e2-505689b10436 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.062564 Jun 07 14:39:34.958647 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 20/47] 10.222.0.85 () {60 vars in 1146 bytes} [Tue Jun 7 14:39:32 2022] POST /compute/v2.1/servers => generated 383 bytes in 2087 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 14:39:34.981649 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-3a2a345c-52c4-4f40-9e74-bb8996480c69 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:34.982593 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-3a2a345c-52c4-4f40-9e74-bb8996480c69 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: ee2e782c-42ff-4093-9246-75d4e69929b3] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:39:35.157576 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-3a2a345c-52c4-4f40-9e74-bb8996480c69 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:39:35.164973 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-3a2a345c-52c4-4f40-9e74-bb8996480c69 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3" status: 200 len: 1219 microversion: 2.1 time: 0.203418 Jun 07 14:39:35.169954 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 21/48] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:39:34 2022] GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3 => generated 1219 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:39:36.102949 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-6137e7ad-a6cc-4a41-aa56-3df9f14fde05 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd800b8efe792477bac3ca063920a4a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd7cee3f5704d01ae9df6d300b30004', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:39:36.114605 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-6137e7ad-a6cc-4a41-aa56-3df9f14fde05 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] 10.222.0.85 "GET /compute/v2.1/servers/af1af1be-6244-4c4f-ac6a-918ace6e2f1d" status: 200 len: 1315 microversion: 2.1 time: 2.747334 Jun 07 14:39:36.115421 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 28/49] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:39:33 2022] GET /compute/v2.1/servers/af1af1be-6244-4c4f-ac6a-918ace6e2f1d => generated 1315 bytes in 2749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:39:36.185624 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-583f08c6-08e3-4cd8-b795-5415e05f4ae6 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:36.186415 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-583f08c6-08e3-4cd8-b795-5415e05f4ae6 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: ee2e782c-42ff-4093-9246-75d4e69929b3] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:39:36.369918 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-583f08c6-08e3-4cd8-b795-5415e05f4ae6 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:39:36.381245 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-583f08c6-08e3-4cd8-b795-5415e05f4ae6 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3" status: 200 len: 1219 microversion: 2.1 time: 0.201732 Jun 07 14:39:36.385086 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 22/50] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:39:36 2022] GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3 => generated 1219 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:39:37.137860 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-98d4e63c-eb94-46e3-82a6-d907e083d22f tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:37.143041 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-98d4e63c-eb94-46e3-82a6-d907e083d22f tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] [instance: af1af1be-6244-4c4f-ac6a-918ace6e2f1d] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:39:37.168908 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-98d4e63c-eb94-46e3-82a6-d907e083d22f tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:37.171317 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-98d4e63c-eb94-46e3-82a6-d907e083d22f tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:37.171317 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-98d4e63c-eb94-46e3-82a6-d907e083d22f tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:37.175723 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-98d4e63c-eb94-46e3-82a6-d907e083d22f tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:37.506420 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [req-5c81610a-4ea2-45fe-8fd4-e03a32db2d7d req-64285709-18fc-4a5f-8f25-11d5e0305d9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af1af1be-6244-4c4f-ac6a-918ace6e2f1d", "tag": "a2f1eff0-8cba-4052-b98d-94d3f0238a13"}]} {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:39:37.574333 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [req-5c81610a-4ea2-45fe-8fd4-e03a32db2d7d req-64285709-18fc-4a5f-8f25-11d5e0305d9f service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:37.577449 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [req-5c81610a-4ea2-45fe-8fd4-e03a32db2d7d req-64285709-18fc-4a5f-8f25-11d5e0305d9f service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:37.658046 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.compute.server_external_events [req-5c81610a-4ea2-45fe-8fd4-e03a32db2d7d req-64285709-18fc-4a5f-8f25-11d5e0305d9f service nova] Creating event network-changed:a2f1eff0-8cba-4052-b98d-94d3f0238a13 for instance af1af1be-6244-4c4f-ac6a-918ace6e2f1d on hv-cinder-84497 Jun 07 14:39:37.658616 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [req-5c81610a-4ea2-45fe-8fd4-e03a32db2d7d req-64285709-18fc-4a5f-8f25-11d5e0305d9f service nova] Acquired lock "compute-rpcapi-router" {{(pid=118157) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 07 14:39:37.660227 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-4a6f4fec-fdb1-4b5c-8518-5ff9b247675d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:37.660717 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-4a6f4fec-fdb1-4b5c-8518-5ff9b247675d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:37.662281 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-4a6f4fec-fdb1-4b5c-8518-5ff9b247675d None None] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:37.664061 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-4a6f4fec-fdb1-4b5c-8518-5ff9b247675d None None] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:37.709026 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.compute.rpcapi [None req-4a6f4fec-fdb1-4b5c-8518-5ff9b247675d None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 07 14:39:37.712705 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-4a6f4fec-fdb1-4b5c-8518-5ff9b247675d None None] Releasing lock "compute-rpcapi-router" {{(pid=118157) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 07 14:39:37.769974 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-4a6f4fec-fdb1-4b5c-8518-5ff9b247675d None None] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.394020 Jun 07 14:39:37.771038 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 23/51] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jun 7 14:39:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:39:37.780976 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-302ecf58-f19c-4cb5-b524-f50f77c8c511 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:37.781702 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-302ecf58-f19c-4cb5-b524-f50f77c8c511 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: ee2e782c-42ff-4093-9246-75d4e69929b3] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:39:37.800469 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-302ecf58-f19c-4cb5-b524-f50f77c8c511 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:37.800867 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-302ecf58-f19c-4cb5-b524-f50f77c8c511 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:37.801763 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-302ecf58-f19c-4cb5-b524-f50f77c8c511 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:37.802207 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-302ecf58-f19c-4cb5-b524-f50f77c8c511 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:37.899662 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-302ecf58-f19c-4cb5-b524-f50f77c8c511 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:39:37.914810 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-302ecf58-f19c-4cb5-b524-f50f77c8c511 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3" status: 200 len: 1223 microversion: 2.1 time: 0.142098 Jun 07 14:39:37.915753 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 24/52] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:39:37 2022] GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3 => generated 1223 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:39:37.943794 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-98d4e63c-eb94-46e3-82a6-d907e083d22f tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd800b8efe792477bac3ca063920a4a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd7cee3f5704d01ae9df6d300b30004', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:39:37.955495 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-98d4e63c-eb94-46e3-82a6-d907e083d22f tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] 10.222.0.85 "GET /compute/v2.1/servers/af1af1be-6244-4c4f-ac6a-918ace6e2f1d" status: 200 len: 1315 microversion: 2.1 time: 0.825444 Jun 07 14:39:37.964244 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 29/53] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:39:37 2022] GET /compute/v2.1/servers/af1af1be-6244-4c4f-ac6a-918ace6e2f1d => generated 1315 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:39:38.112827 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-0effa1c5-2acd-46a3-97cd-c8262a263f8c tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1580100207", "imageRef": "7802ce25-d370-43a3-8d85-0257d644d539", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c15099ef-ea55-434f-a3ed-b2648cb19c55"}], "security_groups": [{"name": "tempest-securitygroup--972251683"}], "key_name": "tempest-keypair-1077111204", "user_data": "}} {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:39:38.496503 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.network.neutron [None req-0effa1c5-2acd-46a3-97cd-c8262a263f8c tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] validate_networks() for [('c15099ef-ea55-434f-a3ed-b2648cb19c55', None, None, None, None, None)] {{(pid=118157) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 14:39:38.507505 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-6295a5ab-1355-4718-83e7-ae206534a887 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2002133735", "imageRef": "7802ce25-d370-43a3-8d85-0257d644d539", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "52ef821c-7cda-47a1-a169-1a51a76fefad"}], "security_groups": [{"name": "tempest-securitygroup--1397693903"}], "key_name": "tempest-keypair-785449831", "user_data": "}} {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:39:38.608786 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG dbcounter [-] [118158] Writing DB stats nova_cell0:SELECT=8 {{(pid=118158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:39:38.716081 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.network.neutron [None req-6295a5ab-1355-4718-83e7-ae206534a887 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] validate_networks() for [('52ef821c-7cda-47a1-a169-1a51a76fefad', None, None, None, None, None)] {{(pid=118158) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 14:39:39.487569 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.virt.hardware [None req-0effa1c5-2acd-46a3-97cd-c8262a263f8c tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Flavor limits 0:0:0 {{(pid=118157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 14:39:39.488118 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.virt.hardware [None req-0effa1c5-2acd-46a3-97cd-c8262a263f8c tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Image limits 0:0:0 {{(pid=118157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 14:39:39.488826 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.virt.hardware [None req-0effa1c5-2acd-46a3-97cd-c8262a263f8c tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Flavor pref 0:0:0 {{(pid=118157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 14:39:39.489384 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.virt.hardware [None req-0effa1c5-2acd-46a3-97cd-c8262a263f8c tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Image pref 0:0:0 {{(pid=118157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 14:39:39.489994 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.virt.hardware [None req-0effa1c5-2acd-46a3-97cd-c8262a263f8c tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 14:39:39.501567 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-0effa1c5-2acd-46a3-97cd-c8262a263f8c tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:39.502246 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-0effa1c5-2acd-46a3-97cd-c8262a263f8c tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:39.503128 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-0effa1c5-2acd-46a3-97cd-c8262a263f8c tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:39.503820 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-0effa1c5-2acd-46a3-97cd-c8262a263f8c tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:39.523159 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.quota [None req-0effa1c5-2acd-46a3-97cd-c8262a263f8c tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Getting quotas for project 97ba26b86c7243dab8e6c6b84ed674e8. Resources: {'instances', 'cores', 'ram'} {{(pid=118157) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 14:39:39.528884 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.quota [None req-0effa1c5-2acd-46a3-97cd-c8262a263f8c tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Getting quotas for user 4fb4b0cf5f8b4274b787f327793964f3 and project 97ba26b86c7243dab8e6c6b84ed674e8. Resources: {'instances', 'cores', 'ram'} {{(pid=118157) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 14:39:39.544194 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-0effa1c5-2acd-46a3-97cd-c8262a263f8c tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Going to run 1 instances... {{(pid=118157) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 14:39:39.547845 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-0effa1c5-2acd-46a3-97cd-c8262a263f8c tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7802ce25-d370-43a3-8d85-0257d644d539',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118157) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 14:39:39.578952 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG dbcounter [-] [118157] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=12 {{(pid=118157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:39:39.646002 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.virt.hardware [None req-6295a5ab-1355-4718-83e7-ae206534a887 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Flavor limits 0:0:0 {{(pid=118158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 14:39:39.646474 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.virt.hardware [None req-6295a5ab-1355-4718-83e7-ae206534a887 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Image limits 0:0:0 {{(pid=118158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 14:39:39.646904 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.virt.hardware [None req-6295a5ab-1355-4718-83e7-ae206534a887 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Flavor pref 0:0:0 {{(pid=118158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 14:39:39.647392 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.virt.hardware [None req-6295a5ab-1355-4718-83e7-ae206534a887 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Image pref 0:0:0 {{(pid=118158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 14:39:39.647842 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.virt.hardware [None req-6295a5ab-1355-4718-83e7-ae206534a887 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 14:39:39.658137 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-6295a5ab-1355-4718-83e7-ae206534a887 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:39.658724 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-6295a5ab-1355-4718-83e7-ae206534a887 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:39.659714 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-6295a5ab-1355-4718-83e7-ae206534a887 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:39.660311 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-6295a5ab-1355-4718-83e7-ae206534a887 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:39.686666 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-0effa1c5-2acd-46a3-97cd-c8262a263f8c tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.578643 Jun 07 14:39:39.692550 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 25/54] 10.222.0.85 () {60 vars in 1146 bytes} [Tue Jun 7 14:39:38 2022] POST /compute/v2.1/servers => generated 401 bytes in 1580 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 14:39:39.695702 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.quota [None req-6295a5ab-1355-4718-83e7-ae206534a887 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Getting quotas for project 8eae64ee53144e4f8d583bb4288c0aeb. Resources: {'instances', 'cores', 'ram'} {{(pid=118158) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 14:39:39.700435 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.quota [None req-6295a5ab-1355-4718-83e7-ae206534a887 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Getting quotas for user 34eb9ec1f3ff44bbb03cf934cb2a04de and project 8eae64ee53144e4f8d583bb4288c0aeb. Resources: {'instances', 'cores', 'ram'} {{(pid=118158) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 14:39:39.703735 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-079176f3-0d60-43ba-9987-a5c9f1ba33ff tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:39.705613 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-079176f3-0d60-43ba-9987-a5c9f1ba33ff tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: ee2e782c-42ff-4093-9246-75d4e69929b3] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:39:39.714712 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-079176f3-0d60-43ba-9987-a5c9f1ba33ff tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:39.716028 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-079176f3-0d60-43ba-9987-a5c9f1ba33ff tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:39.717502 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-079176f3-0d60-43ba-9987-a5c9f1ba33ff tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:39.718744 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-079176f3-0d60-43ba-9987-a5c9f1ba33ff tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:39.744844 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-6295a5ab-1355-4718-83e7-ae206534a887 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Going to run 1 instances... {{(pid=118158) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 14:39:39.768146 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-6295a5ab-1355-4718-83e7-ae206534a887 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 314a1177-9252-4a27-8c30-0b7af796d9a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7802ce25-d370-43a3-8d85-0257d644d539',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118158) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 14:39:39.863289 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-079176f3-0d60-43ba-9987-a5c9f1ba33ff tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:39:39.878829 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-079176f3-0d60-43ba-9987-a5c9f1ba33ff tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3" status: 200 len: 1223 microversion: 2.1 time: 0.190256 Jun 07 14:39:39.880466 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 26/55] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:39:39 2022] GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3 => generated 1223 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:39:39.888912 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-54fc026e-4c81-4127-8a08-f80d813afb39 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:39.896470 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-54fc026e-4c81-4127-8a08-f80d813afb39 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] [instance: af1af1be-6244-4c4f-ac6a-918ace6e2f1d] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:39:39.906795 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-54fc026e-4c81-4127-8a08-f80d813afb39 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:39.907548 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-54fc026e-4c81-4127-8a08-f80d813afb39 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:39.908706 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-54fc026e-4c81-4127-8a08-f80d813afb39 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:39.909422 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-54fc026e-4c81-4127-8a08-f80d813afb39 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:40.037180 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-6295a5ab-1355-4718-83e7-ae206534a887 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.535431 Jun 07 14:39:40.038328 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 30/56] 10.222.0.85 () {60 vars in 1146 bytes} [Tue Jun 7 14:39:38 2022] POST /compute/v2.1/servers => generated 402 bytes in 1537 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 14:39:40.048743 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-6588004a-ae0a-42f2-ad82-4ede42f3d7ad tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:40.063215 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-6588004a-ae0a-42f2-ad82-4ede42f3d7ad tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:39:40.257972 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-54fc026e-4c81-4127-8a08-f80d813afb39 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd800b8efe792477bac3ca063920a4a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd7cee3f5704d01ae9df6d300b30004', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:39:40.281207 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-54fc026e-4c81-4127-8a08-f80d813afb39 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] 10.222.0.85 "GET /compute/v2.1/servers/af1af1be-6244-4c4f-ac6a-918ace6e2f1d" status: 200 len: 1315 microversion: 2.1 time: 0.387804 Jun 07 14:39:40.281207 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 27/57] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:39:39 2022] GET /compute/v2.1/servers/af1af1be-6244-4c4f-ac6a-918ace6e2f1d => generated 1315 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:39:40.308292 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-66810b39-e12d-4238-93f8-13bc351afd35 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:40.310839 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-66810b39-e12d-4238-93f8-13bc351afd35 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 314a1177-9252-4a27-8c30-0b7af796d9a5] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:39:40.317127 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-6588004a-ae0a-42f2-ad82-4ede42f3d7ad tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb4b0cf5f8b4274b787f327793964f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ba26b86c7243dab8e6c6b84ed674e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:39:40.357142 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-6588004a-ae0a-42f2-ad82-4ede42f3d7ad tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6" status: 200 len: 1238 microversion: 2.1 time: 0.315699 Jun 07 14:39:40.362412 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 31/58] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:39:40 2022] GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 => generated 1238 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:39:40.403193 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-66810b39-e12d-4238-93f8-13bc351afd35 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eb9ec1f3ff44bbb03cf934cb2a04de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eae64ee53144e4f8d583bb4288c0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:39:40.414743 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-66810b39-e12d-4238-93f8-13bc351afd35 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/314a1177-9252-4a27-8c30-0b7af796d9a5" status: 200 len: 1241 microversion: 2.1 time: 0.125108 Jun 07 14:39:40.415704 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 28/59] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:39:40 2022] GET /compute/v2.1/servers/314a1177-9252-4a27-8c30-0b7af796d9a5 => generated 1241 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:39:40.896998 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-c0378f26-40f7-41ac-87df-10b418b466cf tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:40.899666 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-c0378f26-40f7-41ac-87df-10b418b466cf tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: ee2e782c-42ff-4093-9246-75d4e69929b3] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:39:40.904318 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-c0378f26-40f7-41ac-87df-10b418b466cf tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:40.905099 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-c0378f26-40f7-41ac-87df-10b418b466cf tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:40.906204 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-c0378f26-40f7-41ac-87df-10b418b466cf tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:40.906906 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-c0378f26-40f7-41ac-87df-10b418b466cf tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:41.134330 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-c0378f26-40f7-41ac-87df-10b418b466cf tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:39:41.148111 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-c0378f26-40f7-41ac-87df-10b418b466cf tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3" status: 200 len: 1223 microversion: 2.1 time: 0.254779 Jun 07 14:39:41.160545 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 32/60] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:39:40 2022] GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3 => generated 1223 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:39:41.291044 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-57f0dfdb-a030-4546-b443-5b404dee8edc tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:41.308535 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-57f0dfdb-a030-4546-b443-5b404dee8edc tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] [instance: af1af1be-6244-4c4f-ac6a-918ace6e2f1d] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:39:41.308535 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-57f0dfdb-a030-4546-b443-5b404dee8edc tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:41.308535 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-57f0dfdb-a030-4546-b443-5b404dee8edc tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:41.308535 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-57f0dfdb-a030-4546-b443-5b404dee8edc tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:41.308975 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-57f0dfdb-a030-4546-b443-5b404dee8edc tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:41.378218 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-9b954206-b17f-4e00-8080-b0dd88de93d6 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:41.379331 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-9b954206-b17f-4e00-8080-b0dd88de93d6 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:39:41.483096 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-9b954206-b17f-4e00-8080-b0dd88de93d6 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb4b0cf5f8b4274b787f327793964f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ba26b86c7243dab8e6c6b84ed674e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:39:41.492417 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-9b954206-b17f-4e00-8080-b0dd88de93d6 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6" status: 200 len: 1238 microversion: 2.1 time: 0.118220 Jun 07 14:39:41.503327 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 33/61] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:39:41 2022] GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 => generated 1238 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:39:41.512409 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-b6738142-f2a7-4ef5-9b66-bc8b6165e11c tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:41.514397 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-b6738142-f2a7-4ef5-9b66-bc8b6165e11c tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 314a1177-9252-4a27-8c30-0b7af796d9a5] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:39:41.543141 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-57f0dfdb-a030-4546-b443-5b404dee8edc tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd800b8efe792477bac3ca063920a4a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd7cee3f5704d01ae9df6d300b30004', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:39:41.551459 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-57f0dfdb-a030-4546-b443-5b404dee8edc tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] 10.222.0.85 "GET /compute/v2.1/servers/af1af1be-6244-4c4f-ac6a-918ace6e2f1d" status: 200 len: 1315 microversion: 2.1 time: 0.266687 Jun 07 14:39:41.552256 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 29/62] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:39:41 2022] GET /compute/v2.1/servers/af1af1be-6244-4c4f-ac6a-918ace6e2f1d => generated 1315 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:39:41.573201 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-b6738142-f2a7-4ef5-9b66-bc8b6165e11c tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eb9ec1f3ff44bbb03cf934cb2a04de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eae64ee53144e4f8d583bb4288c0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:39:41.582169 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-b6738142-f2a7-4ef5-9b66-bc8b6165e11c tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/314a1177-9252-4a27-8c30-0b7af796d9a5" status: 200 len: 1241 microversion: 2.1 time: 0.077300 Jun 07 14:39:41.583498 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 34/63] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:39:41 2022] GET /compute/v2.1/servers/314a1177-9252-4a27-8c30-0b7af796d9a5 => generated 1241 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:39:42.165062 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-55542b92-dee3-4409-85f9-eaae9685736e tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:42.165652 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-55542b92-dee3-4409-85f9-eaae9685736e tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: ee2e782c-42ff-4093-9246-75d4e69929b3] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:39:42.172086 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-55542b92-dee3-4409-85f9-eaae9685736e tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:42.172632 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-55542b92-dee3-4409-85f9-eaae9685736e tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:42.173387 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-55542b92-dee3-4409-85f9-eaae9685736e tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:42.173823 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-55542b92-dee3-4409-85f9-eaae9685736e tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:42.239611 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-55542b92-dee3-4409-85f9-eaae9685736e tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:39:42.248071 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-55542b92-dee3-4409-85f9-eaae9685736e tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3" status: 200 len: 1223 microversion: 2.1 time: 0.086776 Jun 07 14:39:42.249779 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 30/64] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:39:42 2022] GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3 => generated 1223 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:39:42.512406 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-8b77850e-0c85-4401-89c1-778322f0830d tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:42.513306 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-8b77850e-0c85-4401-89c1-778322f0830d tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:39:42.532346 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-8b77850e-0c85-4401-89c1-778322f0830d tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:42.532905 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-8b77850e-0c85-4401-89c1-778322f0830d tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:42.533965 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-8b77850e-0c85-4401-89c1-778322f0830d tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:42.534655 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-8b77850e-0c85-4401-89c1-778322f0830d tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:42.581394 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-f5a2f8a1-9e29-4939-bf44-15e02282bba1 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:42.582042 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-f5a2f8a1-9e29-4939-bf44-15e02282bba1 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] [instance: af1af1be-6244-4c4f-ac6a-918ace6e2f1d] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:39:42.602914 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-f5a2f8a1-9e29-4939-bf44-15e02282bba1 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:42.605979 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-f5a2f8a1-9e29-4939-bf44-15e02282bba1 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:42.612089 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-f5a2f8a1-9e29-4939-bf44-15e02282bba1 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:42.615429 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-f5a2f8a1-9e29-4939-bf44-15e02282bba1 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:42.756048 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-8b77850e-0c85-4401-89c1-778322f0830d tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb4b0cf5f8b4274b787f327793964f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ba26b86c7243dab8e6c6b84ed674e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:39:42.777753 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-8b77850e-0c85-4401-89c1-778322f0830d tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6" status: 200 len: 1242 microversion: 2.1 time: 0.271428 Jun 07 14:39:42.779634 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 35/65] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:39:42 2022] GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 => generated 1242 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:39:42.787929 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-20ec5cac-5bae-408e-8702-4057bf3f79f3 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:42.788819 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-20ec5cac-5bae-408e-8702-4057bf3f79f3 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 314a1177-9252-4a27-8c30-0b7af796d9a5] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:39:42.798003 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-20ec5cac-5bae-408e-8702-4057bf3f79f3 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:42.798687 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-20ec5cac-5bae-408e-8702-4057bf3f79f3 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:42.799705 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-20ec5cac-5bae-408e-8702-4057bf3f79f3 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:42.800283 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-20ec5cac-5bae-408e-8702-4057bf3f79f3 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:42.945306 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-20ec5cac-5bae-408e-8702-4057bf3f79f3 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eb9ec1f3ff44bbb03cf934cb2a04de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eae64ee53144e4f8d583bb4288c0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:39:42.965318 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-20ec5cac-5bae-408e-8702-4057bf3f79f3 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/314a1177-9252-4a27-8c30-0b7af796d9a5" status: 200 len: 1245 microversion: 2.1 time: 0.183228 Jun 07 14:39:42.968538 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 36/66] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:39:42 2022] GET /compute/v2.1/servers/314a1177-9252-4a27-8c30-0b7af796d9a5 => generated 1245 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:39:42.996106 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-f5a2f8a1-9e29-4939-bf44-15e02282bba1 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd800b8efe792477bac3ca063920a4a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd7cee3f5704d01ae9df6d300b30004', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:39:43.026727 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-f5a2f8a1-9e29-4939-bf44-15e02282bba1 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] 10.222.0.85 "GET /compute/v2.1/servers/af1af1be-6244-4c4f-ac6a-918ace6e2f1d" status: 200 len: 1315 microversion: 2.1 time: 0.455894 Jun 07 14:39:43.031853 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 31/67] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:39:42 2022] GET /compute/v2.1/servers/af1af1be-6244-4c4f-ac6a-918ace6e2f1d => generated 1315 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:39:43.268536 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-03693322-d8d0-47e8-8a6b-6dc9dc1bc2ba tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:43.269377 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-03693322-d8d0-47e8-8a6b-6dc9dc1bc2ba tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: ee2e782c-42ff-4093-9246-75d4e69929b3] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:39:43.285341 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-03693322-d8d0-47e8-8a6b-6dc9dc1bc2ba tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:43.286413 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-03693322-d8d0-47e8-8a6b-6dc9dc1bc2ba tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:43.287452 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-03693322-d8d0-47e8-8a6b-6dc9dc1bc2ba tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:43.288182 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-03693322-d8d0-47e8-8a6b-6dc9dc1bc2ba tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:43.537123 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-03693322-d8d0-47e8-8a6b-6dc9dc1bc2ba tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:39:43.558765 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-03693322-d8d0-47e8-8a6b-6dc9dc1bc2ba tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3" status: 200 len: 1223 microversion: 2.1 time: 0.295438 Jun 07 14:39:43.569824 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 37/68] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:39:43 2022] GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3 => generated 1223 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:39:43.802443 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-06dc679b-deb1-472f-a2aa-a68450e06c5c tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:43.803212 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-06dc679b-deb1-472f-a2aa-a68450e06c5c tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:39:43.824772 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-06dc679b-deb1-472f-a2aa-a68450e06c5c tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:43.830502 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-06dc679b-deb1-472f-a2aa-a68450e06c5c tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:43.830502 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-06dc679b-deb1-472f-a2aa-a68450e06c5c tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:43.830502 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-06dc679b-deb1-472f-a2aa-a68450e06c5c tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:43.988700 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-a1fd85e0-85cb-41c1-a358-3f0e3002e256 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:43.991484 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-a1fd85e0-85cb-41c1-a358-3f0e3002e256 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 314a1177-9252-4a27-8c30-0b7af796d9a5] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:39:43.992070 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-06dc679b-deb1-472f-a2aa-a68450e06c5c tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb4b0cf5f8b4274b787f327793964f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ba26b86c7243dab8e6c6b84ed674e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:39:44.005033 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-06dc679b-deb1-472f-a2aa-a68450e06c5c tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6" status: 200 len: 1234 microversion: 2.1 time: 0.210758 Jun 07 14:39:44.011662 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-a1fd85e0-85cb-41c1-a358-3f0e3002e256 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:44.013209 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-a1fd85e0-85cb-41c1-a358-3f0e3002e256 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:44.019062 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 32/69] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:39:43 2022] GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 => generated 1234 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:39:44.028443 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-a1fd85e0-85cb-41c1-a358-3f0e3002e256 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:44.029470 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-a1fd85e0-85cb-41c1-a358-3f0e3002e256 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:44.055021 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-f1a40da5-cc1b-4062-85b9-c432d437c44c tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:44.055744 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-f1a40da5-cc1b-4062-85b9-c432d437c44c tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] [instance: af1af1be-6244-4c4f-ac6a-918ace6e2f1d] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:39:44.078760 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-f1a40da5-cc1b-4062-85b9-c432d437c44c tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:44.079209 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-f1a40da5-cc1b-4062-85b9-c432d437c44c tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:44.080000 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-f1a40da5-cc1b-4062-85b9-c432d437c44c tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:44.088968 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-f1a40da5-cc1b-4062-85b9-c432d437c44c tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:44.254232 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-a1fd85e0-85cb-41c1-a358-3f0e3002e256 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eb9ec1f3ff44bbb03cf934cb2a04de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eae64ee53144e4f8d583bb4288c0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:39:44.283372 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-a1fd85e0-85cb-41c1-a358-3f0e3002e256 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/314a1177-9252-4a27-8c30-0b7af796d9a5" status: 200 len: 1237 microversion: 2.1 time: 0.300759 Jun 07 14:39:44.285271 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 38/70] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:39:43 2022] GET /compute/v2.1/servers/314a1177-9252-4a27-8c30-0b7af796d9a5 => generated 1237 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:39:44.416082 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-f1a40da5-cc1b-4062-85b9-c432d437c44c tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd800b8efe792477bac3ca063920a4a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd7cee3f5704d01ae9df6d300b30004', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:39:44.418746 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG dbcounter [-] [118157] Writing DB stats nova_cell1:SELECT=89 {{(pid=118157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:39:44.425615 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-f1a40da5-cc1b-4062-85b9-c432d437c44c tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] 10.222.0.85 "GET /compute/v2.1/servers/af1af1be-6244-4c4f-ac6a-918ace6e2f1d" status: 200 len: 1315 microversion: 2.1 time: 0.380674 Jun 07 14:39:44.439083 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 33/71] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:39:44 2022] GET /compute/v2.1/servers/af1af1be-6244-4c4f-ac6a-918ace6e2f1d => generated 1315 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:39:44.582521 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-fa7a6928-d81e-4dd9-a5d6-1b01014646b2 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:44.588647 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-fa7a6928-d81e-4dd9-a5d6-1b01014646b2 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: ee2e782c-42ff-4093-9246-75d4e69929b3] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:39:44.639866 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-fa7a6928-d81e-4dd9-a5d6-1b01014646b2 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:44.640408 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-fa7a6928-d81e-4dd9-a5d6-1b01014646b2 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:44.641230 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-fa7a6928-d81e-4dd9-a5d6-1b01014646b2 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:44.645900 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-fa7a6928-d81e-4dd9-a5d6-1b01014646b2 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:44.814446 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-fa7a6928-d81e-4dd9-a5d6-1b01014646b2 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:39:44.825712 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-fa7a6928-d81e-4dd9-a5d6-1b01014646b2 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3" status: 200 len: 1271 microversion: 2.1 time: 0.253463 Jun 07 14:39:44.830010 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 39/72] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:39:44 2022] GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3 => generated 1271 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:39:45.034854 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-c8ca32ec-46b5-41b1-b848-40c1cd1aab91 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:45.036256 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-c8ca32ec-46b5-41b1-b848-40c1cd1aab91 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:39:45.049034 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-c8ca32ec-46b5-41b1-b848-40c1cd1aab91 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:45.052834 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-c8ca32ec-46b5-41b1-b848-40c1cd1aab91 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:45.053943 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-c8ca32ec-46b5-41b1-b848-40c1cd1aab91 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:45.054653 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-c8ca32ec-46b5-41b1-b848-40c1cd1aab91 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:45.157565 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-c8ca32ec-46b5-41b1-b848-40c1cd1aab91 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb4b0cf5f8b4274b787f327793964f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ba26b86c7243dab8e6c6b84ed674e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:39:45.157565 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-c8ca32ec-46b5-41b1-b848-40c1cd1aab91 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6" status: 200 len: 1290 microversion: 2.1 time: 0.125401 Jun 07 14:39:45.157565 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 34/73] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:39:45 2022] GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 => generated 1290 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:39:45.348352 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-7636ef04-b32f-428e-9b1a-671bc2b1edef tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:45.348352 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-7636ef04-b32f-428e-9b1a-671bc2b1edef tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 314a1177-9252-4a27-8c30-0b7af796d9a5] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:39:45.348352 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-7636ef04-b32f-428e-9b1a-671bc2b1edef tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:45.348352 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-7636ef04-b32f-428e-9b1a-671bc2b1edef tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:45.348790 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-7636ef04-b32f-428e-9b1a-671bc2b1edef tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:45.348790 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-7636ef04-b32f-428e-9b1a-671bc2b1edef tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:45.419533 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-7636ef04-b32f-428e-9b1a-671bc2b1edef tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eb9ec1f3ff44bbb03cf934cb2a04de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eae64ee53144e4f8d583bb4288c0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:39:45.429016 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-7636ef04-b32f-428e-9b1a-671bc2b1edef tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/314a1177-9252-4a27-8c30-0b7af796d9a5" status: 200 len: 1293 microversion: 2.1 time: 0.130987 Jun 07 14:39:45.429683 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 40/74] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:39:45 2022] GET /compute/v2.1/servers/314a1177-9252-4a27-8c30-0b7af796d9a5 => generated 1293 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:39:45.443657 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-830367f9-404c-46e7-85a0-e5c1b4e678bb tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:45.444271 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-830367f9-404c-46e7-85a0-e5c1b4e678bb tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] [instance: af1af1be-6244-4c4f-ac6a-918ace6e2f1d] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:39:45.456076 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-830367f9-404c-46e7-85a0-e5c1b4e678bb tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:45.456659 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-830367f9-404c-46e7-85a0-e5c1b4e678bb tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:45.457813 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-830367f9-404c-46e7-85a0-e5c1b4e678bb tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:45.458395 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-830367f9-404c-46e7-85a0-e5c1b4e678bb tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:45.807183 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-830367f9-404c-46e7-85a0-e5c1b4e678bb tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd800b8efe792477bac3ca063920a4a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd7cee3f5704d01ae9df6d300b30004', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:39:45.808820 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-830367f9-404c-46e7-85a0-e5c1b4e678bb tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] 10.222.0.85 "GET /compute/v2.1/servers/af1af1be-6244-4c4f-ac6a-918ace6e2f1d" status: 200 len: 1315 microversion: 2.1 time: 0.366899 Jun 07 14:39:45.810181 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 35/75] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:39:45 2022] GET /compute/v2.1/servers/af1af1be-6244-4c4f-ac6a-918ace6e2f1d => generated 1315 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:39:45.847105 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-180cab7b-72e6-4e54-b6b7-b500e5975770 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:45.847750 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-180cab7b-72e6-4e54-b6b7-b500e5975770 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: ee2e782c-42ff-4093-9246-75d4e69929b3] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:39:45.853937 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-180cab7b-72e6-4e54-b6b7-b500e5975770 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:45.854333 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-180cab7b-72e6-4e54-b6b7-b500e5975770 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:45.855115 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-180cab7b-72e6-4e54-b6b7-b500e5975770 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:45.855559 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-180cab7b-72e6-4e54-b6b7-b500e5975770 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:45.927179 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-180cab7b-72e6-4e54-b6b7-b500e5975770 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:39:45.934753 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-180cab7b-72e6-4e54-b6b7-b500e5975770 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3" status: 200 len: 1271 microversion: 2.1 time: 0.091521 Jun 07 14:39:45.935304 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 41/76] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:39:45 2022] GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3 => generated 1271 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:39:46.173636 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-9075ffac-bf5c-4978-908a-278b324b4fc6 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:46.174501 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-9075ffac-bf5c-4978-908a-278b324b4fc6 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:39:46.180516 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-9075ffac-bf5c-4978-908a-278b324b4fc6 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:46.181056 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-9075ffac-bf5c-4978-908a-278b324b4fc6 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:46.181873 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-9075ffac-bf5c-4978-908a-278b324b4fc6 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:46.182272 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-9075ffac-bf5c-4978-908a-278b324b4fc6 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:46.258697 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-9075ffac-bf5c-4978-908a-278b324b4fc6 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb4b0cf5f8b4274b787f327793964f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ba26b86c7243dab8e6c6b84ed674e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:39:46.266733 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-9075ffac-bf5c-4978-908a-278b324b4fc6 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6" status: 200 len: 1298 microversion: 2.1 time: 0.097927 Jun 07 14:39:46.267535 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 36/77] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:39:46 2022] GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 => generated 1298 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:39:46.449762 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-0241ad5d-4267-46b7-819e-3470116628dc tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:46.450486 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-0241ad5d-4267-46b7-819e-3470116628dc tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 314a1177-9252-4a27-8c30-0b7af796d9a5] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:39:46.459542 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-0241ad5d-4267-46b7-819e-3470116628dc tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:46.460359 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-0241ad5d-4267-46b7-819e-3470116628dc tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:46.462869 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-0241ad5d-4267-46b7-819e-3470116628dc tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:46.462869 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-0241ad5d-4267-46b7-819e-3470116628dc tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:46.535988 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-0241ad5d-4267-46b7-819e-3470116628dc tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eb9ec1f3ff44bbb03cf934cb2a04de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eae64ee53144e4f8d583bb4288c0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:39:46.544354 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-0241ad5d-4267-46b7-819e-3470116628dc tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/314a1177-9252-4a27-8c30-0b7af796d9a5" status: 200 len: 1293 microversion: 2.1 time: 0.099617 Jun 07 14:39:46.553748 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 42/78] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:39:46 2022] GET /compute/v2.1/servers/314a1177-9252-4a27-8c30-0b7af796d9a5 => generated 1293 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:39:46.826440 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-a72ec971-aa40-42b5-80b7-b3474fec5427 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:46.827944 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-a72ec971-aa40-42b5-80b7-b3474fec5427 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] [instance: af1af1be-6244-4c4f-ac6a-918ace6e2f1d] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:39:46.838786 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-a72ec971-aa40-42b5-80b7-b3474fec5427 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:46.839864 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-a72ec971-aa40-42b5-80b7-b3474fec5427 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:46.841232 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-a72ec971-aa40-42b5-80b7-b3474fec5427 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:46.842226 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-a72ec971-aa40-42b5-80b7-b3474fec5427 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:46.958266 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-36f6ae5b-a52b-4aa4-bceb-7bf27a0fc5d9 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:46.961590 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-36f6ae5b-a52b-4aa4-bceb-7bf27a0fc5d9 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: ee2e782c-42ff-4093-9246-75d4e69929b3] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:39:46.967619 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-36f6ae5b-a52b-4aa4-bceb-7bf27a0fc5d9 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:46.968353 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-36f6ae5b-a52b-4aa4-bceb-7bf27a0fc5d9 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:46.969354 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-36f6ae5b-a52b-4aa4-bceb-7bf27a0fc5d9 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:46.970055 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-36f6ae5b-a52b-4aa4-bceb-7bf27a0fc5d9 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:47.008128 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-a72ec971-aa40-42b5-80b7-b3474fec5427 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd800b8efe792477bac3ca063920a4a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd7cee3f5704d01ae9df6d300b30004', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:39:47.017719 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-a72ec971-aa40-42b5-80b7-b3474fec5427 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] 10.222.0.85 "GET /compute/v2.1/servers/af1af1be-6244-4c4f-ac6a-918ace6e2f1d" status: 200 len: 1315 microversion: 2.1 time: 0.195224 Jun 07 14:39:47.018786 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 37/79] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:39:46 2022] GET /compute/v2.1/servers/af1af1be-6244-4c4f-ac6a-918ace6e2f1d => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:39:47.056077 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-36f6ae5b-a52b-4aa4-bceb-7bf27a0fc5d9 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:39:47.065015 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-36f6ae5b-a52b-4aa4-bceb-7bf27a0fc5d9 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3" status: 200 len: 1271 microversion: 2.1 time: 0.110114 Jun 07 14:39:47.065583 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 43/80] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:39:46 2022] GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3 => generated 1271 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:39:47.291274 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-fd9e466a-dc56-4d34-9288-18d228670847 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:47.297567 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-fd9e466a-dc56-4d34-9288-18d228670847 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:39:47.300456 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-fd9e466a-dc56-4d34-9288-18d228670847 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:47.301070 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-fd9e466a-dc56-4d34-9288-18d228670847 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:47.302119 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-fd9e466a-dc56-4d34-9288-18d228670847 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:47.302701 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-fd9e466a-dc56-4d34-9288-18d228670847 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:47.397148 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-fd9e466a-dc56-4d34-9288-18d228670847 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb4b0cf5f8b4274b787f327793964f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ba26b86c7243dab8e6c6b84ed674e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:39:47.429870 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-fd9e466a-dc56-4d34-9288-18d228670847 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6" status: 200 len: 1298 microversion: 2.1 time: 0.135698 Jun 07 14:39:47.429870 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 38/81] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:39:47 2022] GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 => generated 1298 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:39:47.561801 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-517aafdd-7d5c-42f2-8760-fa65cbea6e5a tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:47.562794 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-517aafdd-7d5c-42f2-8760-fa65cbea6e5a tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 314a1177-9252-4a27-8c30-0b7af796d9a5] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:39:47.570790 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-517aafdd-7d5c-42f2-8760-fa65cbea6e5a tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:47.577288 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-517aafdd-7d5c-42f2-8760-fa65cbea6e5a tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:47.578385 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-517aafdd-7d5c-42f2-8760-fa65cbea6e5a tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:47.578891 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-517aafdd-7d5c-42f2-8760-fa65cbea6e5a tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:47.673906 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-517aafdd-7d5c-42f2-8760-fa65cbea6e5a tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eb9ec1f3ff44bbb03cf934cb2a04de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eae64ee53144e4f8d583bb4288c0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:39:47.685161 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-517aafdd-7d5c-42f2-8760-fa65cbea6e5a tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/314a1177-9252-4a27-8c30-0b7af796d9a5" status: 200 len: 1293 microversion: 2.1 time: 0.127373 Jun 07 14:39:47.686157 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 44/82] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:39:47 2022] GET /compute/v2.1/servers/314a1177-9252-4a27-8c30-0b7af796d9a5 => generated 1293 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:39:48.035617 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-bb3d7d8a-8605-4c42-ac9e-468385f0023e tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:48.036975 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-bb3d7d8a-8605-4c42-ac9e-468385f0023e tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] [instance: af1af1be-6244-4c4f-ac6a-918ace6e2f1d] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:39:48.045593 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-bb3d7d8a-8605-4c42-ac9e-468385f0023e tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:48.046063 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-bb3d7d8a-8605-4c42-ac9e-468385f0023e tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:48.046914 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-bb3d7d8a-8605-4c42-ac9e-468385f0023e tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:48.047522 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-bb3d7d8a-8605-4c42-ac9e-468385f0023e tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:48.090003 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-4ca440e6-83a0-47be-a38a-0837bbd773b7 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:48.090911 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-4ca440e6-83a0-47be-a38a-0837bbd773b7 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: ee2e782c-42ff-4093-9246-75d4e69929b3] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:39:48.098277 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-4ca440e6-83a0-47be-a38a-0837bbd773b7 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:48.104782 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-4ca440e6-83a0-47be-a38a-0837bbd773b7 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:48.105725 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-4ca440e6-83a0-47be-a38a-0837bbd773b7 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:48.106173 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-4ca440e6-83a0-47be-a38a-0837bbd773b7 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:48.110930 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG dbcounter [-] [118158] Writing DB stats nova_cell1:SELECT=100 {{(pid=118158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:39:48.195180 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-4ca440e6-83a0-47be-a38a-0837bbd773b7 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:39:48.210126 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-4ca440e6-83a0-47be-a38a-0837bbd773b7 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3" status: 200 len: 1279 microversion: 2.1 time: 0.123941 Jun 07 14:39:48.210712 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 45/83] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:39:48 2022] GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3 => generated 1279 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:39:48.253427 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-bb3d7d8a-8605-4c42-ac9e-468385f0023e tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd800b8efe792477bac3ca063920a4a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd7cee3f5704d01ae9df6d300b30004', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:39:48.262596 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-bb3d7d8a-8605-4c42-ac9e-468385f0023e tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] 10.222.0.85 "GET /compute/v2.1/servers/af1af1be-6244-4c4f-ac6a-918ace6e2f1d" status: 200 len: 1315 microversion: 2.1 time: 0.230541 Jun 07 14:39:48.273319 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 39/84] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:39:48 2022] GET /compute/v2.1/servers/af1af1be-6244-4c4f-ac6a-918ace6e2f1d => generated 1315 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:39:48.440779 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-4e342189-e651-423c-89f5-5e3e1b23c18f tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:48.442966 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-4e342189-e651-423c-89f5-5e3e1b23c18f tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:39:48.451618 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-4e342189-e651-423c-89f5-5e3e1b23c18f tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:48.453255 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-4e342189-e651-423c-89f5-5e3e1b23c18f tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:48.454727 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-4e342189-e651-423c-89f5-5e3e1b23c18f tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:48.455525 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-4e342189-e651-423c-89f5-5e3e1b23c18f tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:48.586394 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-4e342189-e651-423c-89f5-5e3e1b23c18f tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb4b0cf5f8b4274b787f327793964f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ba26b86c7243dab8e6c6b84ed674e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:39:48.594083 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-4e342189-e651-423c-89f5-5e3e1b23c18f tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6" status: 200 len: 1308 microversion: 2.1 time: 0.158685 Jun 07 14:39:48.594646 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 46/85] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:39:48 2022] GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 => generated 1308 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:39:48.701691 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-c6a9af8e-52eb-420d-9704-947300bd10f0 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:48.702613 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-c6a9af8e-52eb-420d-9704-947300bd10f0 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 314a1177-9252-4a27-8c30-0b7af796d9a5] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:39:48.711701 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-c6a9af8e-52eb-420d-9704-947300bd10f0 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:48.711843 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-c6a9af8e-52eb-420d-9704-947300bd10f0 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:48.712891 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-c6a9af8e-52eb-420d-9704-947300bd10f0 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:48.713334 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-c6a9af8e-52eb-420d-9704-947300bd10f0 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:48.778774 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-c6a9af8e-52eb-420d-9704-947300bd10f0 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eb9ec1f3ff44bbb03cf934cb2a04de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eae64ee53144e4f8d583bb4288c0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:39:48.787030 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-c6a9af8e-52eb-420d-9704-947300bd10f0 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/314a1177-9252-4a27-8c30-0b7af796d9a5" status: 200 len: 1301 microversion: 2.1 time: 0.088384 Jun 07 14:39:48.795487 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 40/86] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:39:48 2022] GET /compute/v2.1/servers/314a1177-9252-4a27-8c30-0b7af796d9a5 => generated 1301 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:39:48.869455 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [req-51f8ebec-aa40-42c1-83ae-bd7d7d14da3e req-0ff368e3-3f08-4fe6-be82-ba0cd452e97a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45f65f98-e1ca-4e07-872a-ef0403e2d50a", "tag": "568ba600-2682-4efd-8fd6-ca711d30e17a"}]} {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:39:48.899518 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [req-51f8ebec-aa40-42c1-83ae-bd7d7d14da3e req-0ff368e3-3f08-4fe6-be82-ba0cd452e97a service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:48.899968 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [req-51f8ebec-aa40-42c1-83ae-bd7d7d14da3e req-0ff368e3-3f08-4fe6-be82-ba0cd452e97a service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:48.921646 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.compute.server_external_events [req-51f8ebec-aa40-42c1-83ae-bd7d7d14da3e req-0ff368e3-3f08-4fe6-be82-ba0cd452e97a service nova] Creating event network-changed:568ba600-2682-4efd-8fd6-ca711d30e17a for instance 45f65f98-e1ca-4e07-872a-ef0403e2d50a on hv-cinder-84497 Jun 07 14:39:48.922187 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [req-51f8ebec-aa40-42c1-83ae-bd7d7d14da3e req-0ff368e3-3f08-4fe6-be82-ba0cd452e97a service nova] Acquired lock "compute-rpcapi-router" {{(pid=118158) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 07 14:39:48.923278 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-6c17bc0f-58f6-4803-8c74-be0e96c7b7d0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:48.923717 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-6c17bc0f-58f6-4803-8c74-be0e96c7b7d0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:48.924520 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-6c17bc0f-58f6-4803-8c74-be0e96c7b7d0 None None] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:48.924948 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-6c17bc0f-58f6-4803-8c74-be0e96c7b7d0 None None] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:48.938068 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.compute.rpcapi [None req-6c17bc0f-58f6-4803-8c74-be0e96c7b7d0 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 07 14:39:48.939194 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-6c17bc0f-58f6-4803-8c74-be0e96c7b7d0 None None] Releasing lock "compute-rpcapi-router" {{(pid=118158) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 07 14:39:48.966291 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-6c17bc0f-58f6-4803-8c74-be0e96c7b7d0 None None] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118176 Jun 07 14:39:48.967465 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 47/87] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jun 7 14:39:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:39:49.227247 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-94ac42c4-6f88-437a-bfc9-d36bd32f7491 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:49.227776 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-94ac42c4-6f88-437a-bfc9-d36bd32f7491 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: ee2e782c-42ff-4093-9246-75d4e69929b3] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:39:49.233992 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-94ac42c4-6f88-437a-bfc9-d36bd32f7491 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:49.234436 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-94ac42c4-6f88-437a-bfc9-d36bd32f7491 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:49.235189 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-94ac42c4-6f88-437a-bfc9-d36bd32f7491 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:49.235668 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-94ac42c4-6f88-437a-bfc9-d36bd32f7491 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:49.281429 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-fc502c10-a030-491a-bbaf-b86cfc71966e tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:49.282157 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-fc502c10-a030-491a-bbaf-b86cfc71966e tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] [instance: af1af1be-6244-4c4f-ac6a-918ace6e2f1d] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:39:49.288548 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-fc502c10-a030-491a-bbaf-b86cfc71966e tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:49.288996 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-fc502c10-a030-491a-bbaf-b86cfc71966e tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:49.289759 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-fc502c10-a030-491a-bbaf-b86cfc71966e tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:49.290190 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-fc502c10-a030-491a-bbaf-b86cfc71966e tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:49.297764 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-94ac42c4-6f88-437a-bfc9-d36bd32f7491 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:39:49.305594 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-94ac42c4-6f88-437a-bfc9-d36bd32f7491 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3" status: 200 len: 1279 microversion: 2.1 time: 0.082370 Jun 07 14:39:49.306157 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 41/88] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:39:49 2022] GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3 => generated 1279 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:39:49.434597 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-fc502c10-a030-491a-bbaf-b86cfc71966e tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd800b8efe792477bac3ca063920a4a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd7cee3f5704d01ae9df6d300b30004', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:39:49.442913 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-fc502c10-a030-491a-bbaf-b86cfc71966e tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] 10.222.0.85 "GET /compute/v2.1/servers/af1af1be-6244-4c4f-ac6a-918ace6e2f1d" status: 200 len: 1315 microversion: 2.1 time: 0.166128 Jun 07 14:39:49.443521 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 48/89] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:39:49 2022] GET /compute/v2.1/servers/af1af1be-6244-4c4f-ac6a-918ace6e2f1d => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:39:49.614209 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-9da18a7a-55e3-45df-90f1-c01d9867a349 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:49.615474 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-9da18a7a-55e3-45df-90f1-c01d9867a349 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:39:49.626079 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG dbcounter [-] [118157] Writing DB stats nova_cell0:SELECT=8 {{(pid=118157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:39:49.632391 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-9da18a7a-55e3-45df-90f1-c01d9867a349 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:49.633108 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-9da18a7a-55e3-45df-90f1-c01d9867a349 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:49.636789 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-9da18a7a-55e3-45df-90f1-c01d9867a349 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:49.636789 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-9da18a7a-55e3-45df-90f1-c01d9867a349 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:49.730507 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-9da18a7a-55e3-45df-90f1-c01d9867a349 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb4b0cf5f8b4274b787f327793964f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ba26b86c7243dab8e6c6b84ed674e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:39:49.738988 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-9da18a7a-55e3-45df-90f1-c01d9867a349 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6" status: 200 len: 1308 microversion: 2.1 time: 0.131269 Jun 07 14:39:49.739621 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 42/90] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:39:49 2022] GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 => generated 1308 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:39:49.803467 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-6eff78ef-1381-411c-a994-d1c50b45ed55 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:49.804080 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-6eff78ef-1381-411c-a994-d1c50b45ed55 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 314a1177-9252-4a27-8c30-0b7af796d9a5] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:39:49.810639 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-6eff78ef-1381-411c-a994-d1c50b45ed55 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:49.816213 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-6eff78ef-1381-411c-a994-d1c50b45ed55 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:49.816213 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-6eff78ef-1381-411c-a994-d1c50b45ed55 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:49.816213 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-6eff78ef-1381-411c-a994-d1c50b45ed55 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:49.926086 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-6eff78ef-1381-411c-a994-d1c50b45ed55 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eb9ec1f3ff44bbb03cf934cb2a04de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eae64ee53144e4f8d583bb4288c0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:39:49.948477 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-6eff78ef-1381-411c-a994-d1c50b45ed55 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/314a1177-9252-4a27-8c30-0b7af796d9a5" status: 200 len: 1301 microversion: 2.1 time: 0.144387 Jun 07 14:39:49.949445 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 49/91] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:39:49 2022] GET /compute/v2.1/servers/314a1177-9252-4a27-8c30-0b7af796d9a5 => generated 1301 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:39:50.325167 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-d845216d-ec8e-4996-b41c-f83b421ac4a0 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:50.327391 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-d845216d-ec8e-4996-b41c-f83b421ac4a0 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: ee2e782c-42ff-4093-9246-75d4e69929b3] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:39:50.355083 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-d845216d-ec8e-4996-b41c-f83b421ac4a0 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:50.355813 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-d845216d-ec8e-4996-b41c-f83b421ac4a0 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:50.356784 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-d845216d-ec8e-4996-b41c-f83b421ac4a0 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:50.357507 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-d845216d-ec8e-4996-b41c-f83b421ac4a0 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:50.429887 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG dbcounter [-] [118157] Writing DB stats nova_cell0:SELECT=26 {{(pid=118157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:39:50.470068 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-96e7558b-653e-4719-b237-0e998a245047 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:50.470068 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-96e7558b-653e-4719-b237-0e998a245047 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] [instance: af1af1be-6244-4c4f-ac6a-918ace6e2f1d] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:39:50.488556 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-96e7558b-653e-4719-b237-0e998a245047 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:50.489408 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-96e7558b-653e-4719-b237-0e998a245047 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:50.490433 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-96e7558b-653e-4719-b237-0e998a245047 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:50.491021 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-96e7558b-653e-4719-b237-0e998a245047 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:50.632981 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-d845216d-ec8e-4996-b41c-f83b421ac4a0 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:39:50.644195 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-d845216d-ec8e-4996-b41c-f83b421ac4a0 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3" status: 200 len: 1289 microversion: 2.1 time: 0.324878 Jun 07 14:39:50.654075 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 43/92] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:39:50 2022] GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3 => generated 1289 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:39:50.763740 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-fff8b218-4f36-452d-969f-bbd53939c35c tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:50.766832 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-fff8b218-4f36-452d-969f-bbd53939c35c tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:39:50.774514 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-fff8b218-4f36-452d-969f-bbd53939c35c tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:50.775366 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-fff8b218-4f36-452d-969f-bbd53939c35c tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:50.776261 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-fff8b218-4f36-452d-969f-bbd53939c35c tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:50.776847 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-fff8b218-4f36-452d-969f-bbd53939c35c tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:50.930867 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-fff8b218-4f36-452d-969f-bbd53939c35c tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb4b0cf5f8b4274b787f327793964f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ba26b86c7243dab8e6c6b84ed674e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:39:50.963166 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-fff8b218-4f36-452d-969f-bbd53939c35c tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6" status: 200 len: 1296 microversion: 2.1 time: 0.181530 Jun 07 14:39:50.963166 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 44/93] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:39:50 2022] GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 => generated 1296 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:39:50.977927 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-87fdeca3-cb34-4844-a8b3-fdb40f962d31 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:50.978723 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-87fdeca3-cb34-4844-a8b3-fdb40f962d31 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 314a1177-9252-4a27-8c30-0b7af796d9a5] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:39:50.987047 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-87fdeca3-cb34-4844-a8b3-fdb40f962d31 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:50.987510 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-87fdeca3-cb34-4844-a8b3-fdb40f962d31 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:50.988302 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-87fdeca3-cb34-4844-a8b3-fdb40f962d31 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:50.988780 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-87fdeca3-cb34-4844-a8b3-fdb40f962d31 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:51.082118 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-87fdeca3-cb34-4844-a8b3-fdb40f962d31 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eb9ec1f3ff44bbb03cf934cb2a04de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eae64ee53144e4f8d583bb4288c0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:39:51.090325 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-87fdeca3-cb34-4844-a8b3-fdb40f962d31 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/314a1177-9252-4a27-8c30-0b7af796d9a5" status: 200 len: 1311 microversion: 2.1 time: 0.121959 Jun 07 14:39:51.090902 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 45/94] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:39:50 2022] GET /compute/v2.1/servers/314a1177-9252-4a27-8c30-0b7af796d9a5 => generated 1311 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:39:51.118881 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-96e7558b-653e-4719-b237-0e998a245047 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd800b8efe792477bac3ca063920a4a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd7cee3f5704d01ae9df6d300b30004', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:39:51.128858 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-96e7558b-653e-4719-b237-0e998a245047 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] 10.222.0.85 "GET /compute/v2.1/servers/af1af1be-6244-4c4f-ac6a-918ace6e2f1d" status: 200 len: 1315 microversion: 2.1 time: 0.671017 Jun 07 14:39:51.134517 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 50/95] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:39:50 2022] GET /compute/v2.1/servers/af1af1be-6244-4c4f-ac6a-918ace6e2f1d => generated 1315 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:39:51.663766 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-413c1367-3033-4c2e-b1be-1c4667b6ffbc tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:51.664541 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-413c1367-3033-4c2e-b1be-1c4667b6ffbc tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: ee2e782c-42ff-4093-9246-75d4e69929b3] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:39:51.672106 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-413c1367-3033-4c2e-b1be-1c4667b6ffbc tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:51.676072 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-413c1367-3033-4c2e-b1be-1c4667b6ffbc tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:51.676072 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-413c1367-3033-4c2e-b1be-1c4667b6ffbc tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:51.676072 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-413c1367-3033-4c2e-b1be-1c4667b6ffbc tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:51.778077 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-413c1367-3033-4c2e-b1be-1c4667b6ffbc tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:39:51.788386 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-413c1367-3033-4c2e-b1be-1c4667b6ffbc tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3" status: 200 len: 1277 microversion: 2.1 time: 0.129421 Jun 07 14:39:51.791417 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 46/96] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:39:51 2022] GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3 => generated 1277 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:39:51.974691 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-68b1e1f9-2fd5-4dd8-96f9-17154d7a05fc tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:51.976614 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-68b1e1f9-2fd5-4dd8-96f9-17154d7a05fc tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:39:51.979944 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG dbcounter [-] [118158] Writing DB stats nova_cell0:SELECT=12 {{(pid=118158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:39:51.989636 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG dbcounter [-] [118158] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=118158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:39:51.991526 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-68b1e1f9-2fd5-4dd8-96f9-17154d7a05fc tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:51.992334 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-68b1e1f9-2fd5-4dd8-96f9-17154d7a05fc tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:51.993334 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-68b1e1f9-2fd5-4dd8-96f9-17154d7a05fc tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:51.993878 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-68b1e1f9-2fd5-4dd8-96f9-17154d7a05fc tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:52.095328 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-68b1e1f9-2fd5-4dd8-96f9-17154d7a05fc tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb4b0cf5f8b4274b787f327793964f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ba26b86c7243dab8e6c6b84ed674e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:39:52.121744 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-be22f635-b879-48f1-b8f0-63920a97cbad tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:52.121744 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-be22f635-b879-48f1-b8f0-63920a97cbad tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 314a1177-9252-4a27-8c30-0b7af796d9a5] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:39:52.121897 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-68b1e1f9-2fd5-4dd8-96f9-17154d7a05fc tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6" status: 200 len: 1296 microversion: 2.1 time: 0.145204 Jun 07 14:39:52.121897 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 51/97] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:39:51 2022] GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 => generated 1296 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:39:52.122954 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-be22f635-b879-48f1-b8f0-63920a97cbad tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:52.125174 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-be22f635-b879-48f1-b8f0-63920a97cbad tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:52.126457 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-be22f635-b879-48f1-b8f0-63920a97cbad tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:52.126899 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-be22f635-b879-48f1-b8f0-63920a97cbad tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:52.159910 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-a4565531-2c5d-40ff-b346-eaf83947576d tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:52.161083 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-a4565531-2c5d-40ff-b346-eaf83947576d tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] [instance: af1af1be-6244-4c4f-ac6a-918ace6e2f1d] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:39:52.174456 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-a4565531-2c5d-40ff-b346-eaf83947576d tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:52.174919 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-a4565531-2c5d-40ff-b346-eaf83947576d tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:52.175711 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-a4565531-2c5d-40ff-b346-eaf83947576d tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:52.176200 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-a4565531-2c5d-40ff-b346-eaf83947576d tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:52.233801 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-be22f635-b879-48f1-b8f0-63920a97cbad tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eb9ec1f3ff44bbb03cf934cb2a04de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eae64ee53144e4f8d583bb4288c0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:39:52.242651 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-be22f635-b879-48f1-b8f0-63920a97cbad tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/314a1177-9252-4a27-8c30-0b7af796d9a5" status: 200 len: 1299 microversion: 2.1 time: 0.136974 Jun 07 14:39:52.243605 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 47/98] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:39:52 2022] GET /compute/v2.1/servers/314a1177-9252-4a27-8c30-0b7af796d9a5 => generated 1299 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:39:52.596260 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-a4565531-2c5d-40ff-b346-eaf83947576d tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd800b8efe792477bac3ca063920a4a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd7cee3f5704d01ae9df6d300b30004', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:39:52.608033 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-a4565531-2c5d-40ff-b346-eaf83947576d tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] 10.222.0.85 "GET /compute/v2.1/servers/af1af1be-6244-4c4f-ac6a-918ace6e2f1d" status: 200 len: 1315 microversion: 2.1 time: 0.464608 Jun 07 14:39:52.609034 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 52/99] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:39:52 2022] GET /compute/v2.1/servers/af1af1be-6244-4c4f-ac6a-918ace6e2f1d => generated 1315 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:39:52.808418 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-9415b958-262d-4b1f-90ff-40715bafae47 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:52.809235 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-9415b958-262d-4b1f-90ff-40715bafae47 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: ee2e782c-42ff-4093-9246-75d4e69929b3] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:39:52.820072 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-9415b958-262d-4b1f-90ff-40715bafae47 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:52.820844 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-9415b958-262d-4b1f-90ff-40715bafae47 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:52.821640 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-9415b958-262d-4b1f-90ff-40715bafae47 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:52.822120 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-9415b958-262d-4b1f-90ff-40715bafae47 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:53.004969 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-9415b958-262d-4b1f-90ff-40715bafae47 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:39:53.014066 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-9415b958-262d-4b1f-90ff-40715bafae47 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3" status: 200 len: 1319 microversion: 2.1 time: 0.211521 Jun 07 14:39:53.016409 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 48/100] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:39:52 2022] GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3 => generated 1319 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:39:53.136702 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-6090239d-1e22-4d7c-ab39-1a24012a19ea tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:53.137576 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-6090239d-1e22-4d7c-ab39-1a24012a19ea tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:39:53.143480 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-6090239d-1e22-4d7c-ab39-1a24012a19ea tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:53.144003 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-6090239d-1e22-4d7c-ab39-1a24012a19ea tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:53.145041 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-6090239d-1e22-4d7c-ab39-1a24012a19ea tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:53.145602 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-6090239d-1e22-4d7c-ab39-1a24012a19ea tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:53.266955 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-26fa2baa-d1a1-4785-ad51-6f040ae3621c tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:53.267818 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-26fa2baa-d1a1-4785-ad51-6f040ae3621c tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 314a1177-9252-4a27-8c30-0b7af796d9a5] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:39:53.280952 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-26fa2baa-d1a1-4785-ad51-6f040ae3621c tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:53.281563 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-26fa2baa-d1a1-4785-ad51-6f040ae3621c tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:53.282511 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-26fa2baa-d1a1-4785-ad51-6f040ae3621c tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:53.282946 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-26fa2baa-d1a1-4785-ad51-6f040ae3621c tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:53.302588 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-6090239d-1e22-4d7c-ab39-1a24012a19ea tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb4b0cf5f8b4274b787f327793964f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ba26b86c7243dab8e6c6b84ed674e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:39:53.310580 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-6090239d-1e22-4d7c-ab39-1a24012a19ea tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6" status: 200 len: 1363 microversion: 2.1 time: 0.177675 Jun 07 14:39:53.321367 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 53/101] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:39:53 2022] GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 => generated 1363 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:39:53.431888 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-26fa2baa-d1a1-4785-ad51-6f040ae3621c tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eb9ec1f3ff44bbb03cf934cb2a04de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eae64ee53144e4f8d583bb4288c0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:39:53.440268 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-26fa2baa-d1a1-4785-ad51-6f040ae3621c tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/314a1177-9252-4a27-8c30-0b7af796d9a5" status: 200 len: 1367 microversion: 2.1 time: 0.181084 Jun 07 14:39:53.440832 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 49/102] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:39:53 2022] GET /compute/v2.1/servers/314a1177-9252-4a27-8c30-0b7af796d9a5 => generated 1367 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:39:53.626068 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-e2a1b2fc-f68e-4a7d-9847-bec0376ec370 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:53.626674 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-e2a1b2fc-f68e-4a7d-9847-bec0376ec370 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] [instance: af1af1be-6244-4c4f-ac6a-918ace6e2f1d] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:39:53.632919 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-e2a1b2fc-f68e-4a7d-9847-bec0376ec370 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:53.633363 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-e2a1b2fc-f68e-4a7d-9847-bec0376ec370 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:53.634110 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-e2a1b2fc-f68e-4a7d-9847-bec0376ec370 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:53.634548 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-e2a1b2fc-f68e-4a7d-9847-bec0376ec370 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:53.785843 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-e2a1b2fc-f68e-4a7d-9847-bec0376ec370 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd800b8efe792477bac3ca063920a4a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd7cee3f5704d01ae9df6d300b30004', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:39:53.797479 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-e2a1b2fc-f68e-4a7d-9847-bec0376ec370 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] 10.222.0.85 "GET /compute/v2.1/servers/af1af1be-6244-4c4f-ac6a-918ace6e2f1d" status: 200 len: 1315 microversion: 2.1 time: 0.175189 Jun 07 14:39:53.807329 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 54/103] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:39:53 2022] GET /compute/v2.1/servers/af1af1be-6244-4c4f-ac6a-918ace6e2f1d => generated 1315 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:39:54.031960 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-548324e6-7181-4f25-ad91-4f8f2eb8f146 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:54.032650 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-548324e6-7181-4f25-ad91-4f8f2eb8f146 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: ee2e782c-42ff-4093-9246-75d4e69929b3] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:39:54.038740 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-548324e6-7181-4f25-ad91-4f8f2eb8f146 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:54.039341 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-548324e6-7181-4f25-ad91-4f8f2eb8f146 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:54.039951 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-548324e6-7181-4f25-ad91-4f8f2eb8f146 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:54.040415 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-548324e6-7181-4f25-ad91-4f8f2eb8f146 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:54.054958 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG dbcounter [-] [118157] Writing DB stats nova_cell1:SELECT=100 {{(pid=118157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:39:54.167512 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-548324e6-7181-4f25-ad91-4f8f2eb8f146 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:39:54.175210 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-548324e6-7181-4f25-ad91-4f8f2eb8f146 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3" status: 200 len: 1319 microversion: 2.1 time: 0.147699 Jun 07 14:39:54.175774 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 50/104] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:39:54 2022] GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:39:54.329348 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-dedfef6c-0cb9-471a-8afd-7a059858302b tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:54.330097 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-dedfef6c-0cb9-471a-8afd-7a059858302b tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:39:54.341227 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-dedfef6c-0cb9-471a-8afd-7a059858302b tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:54.341227 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-dedfef6c-0cb9-471a-8afd-7a059858302b tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:54.341227 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-dedfef6c-0cb9-471a-8afd-7a059858302b tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:54.341227 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-dedfef6c-0cb9-471a-8afd-7a059858302b tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:54.459434 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-b1cd36fd-2aa6-4e8c-8785-5f847352d923 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:54.460508 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-b1cd36fd-2aa6-4e8c-8785-5f847352d923 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 314a1177-9252-4a27-8c30-0b7af796d9a5] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:39:54.466814 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-b1cd36fd-2aa6-4e8c-8785-5f847352d923 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:54.467401 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-b1cd36fd-2aa6-4e8c-8785-5f847352d923 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:54.468434 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-b1cd36fd-2aa6-4e8c-8785-5f847352d923 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:54.468952 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-b1cd36fd-2aa6-4e8c-8785-5f847352d923 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:54.476300 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-dedfef6c-0cb9-471a-8afd-7a059858302b tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb4b0cf5f8b4274b787f327793964f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ba26b86c7243dab8e6c6b84ed674e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:39:54.486181 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-dedfef6c-0cb9-471a-8afd-7a059858302b tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6" status: 200 len: 1363 microversion: 2.1 time: 0.161541 Jun 07 14:39:54.491369 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 55/105] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:39:54 2022] GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:39:54.620069 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-b1cd36fd-2aa6-4e8c-8785-5f847352d923 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eb9ec1f3ff44bbb03cf934cb2a04de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eae64ee53144e4f8d583bb4288c0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:39:54.627891 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-b1cd36fd-2aa6-4e8c-8785-5f847352d923 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/314a1177-9252-4a27-8c30-0b7af796d9a5" status: 200 len: 1367 microversion: 2.1 time: 0.172387 Jun 07 14:39:54.628460 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 51/106] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:39:54 2022] GET /compute/v2.1/servers/314a1177-9252-4a27-8c30-0b7af796d9a5 => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:39:54.820570 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-91dcec36-840e-403b-be70-ddb40dd977c1 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:54.822336 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-91dcec36-840e-403b-be70-ddb40dd977c1 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] [instance: af1af1be-6244-4c4f-ac6a-918ace6e2f1d] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:39:54.835907 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-91dcec36-840e-403b-be70-ddb40dd977c1 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:54.835907 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-91dcec36-840e-403b-be70-ddb40dd977c1 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:54.836454 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-91dcec36-840e-403b-be70-ddb40dd977c1 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:54.836975 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-91dcec36-840e-403b-be70-ddb40dd977c1 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:54.982560 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-91dcec36-840e-403b-be70-ddb40dd977c1 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd800b8efe792477bac3ca063920a4a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd7cee3f5704d01ae9df6d300b30004', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:39:54.994482 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-91dcec36-840e-403b-be70-ddb40dd977c1 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] 10.222.0.85 "GET /compute/v2.1/servers/af1af1be-6244-4c4f-ac6a-918ace6e2f1d" status: 200 len: 1315 microversion: 2.1 time: 0.178108 Jun 07 14:39:54.994482 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 56/107] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:39:54 2022] GET /compute/v2.1/servers/af1af1be-6244-4c4f-ac6a-918ace6e2f1d => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:39:55.191391 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-167af782-49cb-4793-953e-1bf20d9d1bc0 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:55.192075 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-167af782-49cb-4793-953e-1bf20d9d1bc0 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: ee2e782c-42ff-4093-9246-75d4e69929b3] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:39:55.198149 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-167af782-49cb-4793-953e-1bf20d9d1bc0 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:55.198595 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-167af782-49cb-4793-953e-1bf20d9d1bc0 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:55.199363 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-167af782-49cb-4793-953e-1bf20d9d1bc0 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:55.199801 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-167af782-49cb-4793-953e-1bf20d9d1bc0 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:55.469124 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-167af782-49cb-4793-953e-1bf20d9d1bc0 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:39:55.476948 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-167af782-49cb-4793-953e-1bf20d9d1bc0 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3" status: 200 len: 1319 microversion: 2.1 time: 0.289342 Jun 07 14:39:55.477943 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 52/108] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:39:55 2022] GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3 => generated 1319 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:39:55.511288 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-7bd2e24b-7795-4cf2-bf07-d667bd78980f tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:55.511910 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-7bd2e24b-7795-4cf2-bf07-d667bd78980f tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:39:55.518946 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-7bd2e24b-7795-4cf2-bf07-d667bd78980f tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:55.519471 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-7bd2e24b-7795-4cf2-bf07-d667bd78980f tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:55.520247 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-7bd2e24b-7795-4cf2-bf07-d667bd78980f tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:55.520715 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-7bd2e24b-7795-4cf2-bf07-d667bd78980f tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:55.645223 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-3b017b2f-b8cd-4479-9a23-73cd053cbd00 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:55.645951 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-3b017b2f-b8cd-4479-9a23-73cd053cbd00 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 314a1177-9252-4a27-8c30-0b7af796d9a5] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:39:55.650653 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-7bd2e24b-7795-4cf2-bf07-d667bd78980f tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb4b0cf5f8b4274b787f327793964f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ba26b86c7243dab8e6c6b84ed674e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:39:55.653944 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-3b017b2f-b8cd-4479-9a23-73cd053cbd00 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:55.655503 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-3b017b2f-b8cd-4479-9a23-73cd053cbd00 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:55.656482 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-3b017b2f-b8cd-4479-9a23-73cd053cbd00 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:55.660039 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-3b017b2f-b8cd-4479-9a23-73cd053cbd00 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:55.660148 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-7bd2e24b-7795-4cf2-bf07-d667bd78980f tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6" status: 200 len: 1363 microversion: 2.1 time: 0.151825 Jun 07 14:39:55.660148 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 57/109] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:39:55 2022] GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:39:55.799459 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-3b017b2f-b8cd-4479-9a23-73cd053cbd00 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eb9ec1f3ff44bbb03cf934cb2a04de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eae64ee53144e4f8d583bb4288c0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:39:55.806918 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-3b017b2f-b8cd-4479-9a23-73cd053cbd00 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/314a1177-9252-4a27-8c30-0b7af796d9a5" status: 200 len: 1367 microversion: 2.1 time: 0.165644 Jun 07 14:39:55.807703 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 53/110] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:39:55 2022] GET /compute/v2.1/servers/314a1177-9252-4a27-8c30-0b7af796d9a5 => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:39:56.008398 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-90be3087-65bd-447a-81a8-9a374297cebc tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:56.012577 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-90be3087-65bd-447a-81a8-9a374297cebc tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] [instance: af1af1be-6244-4c4f-ac6a-918ace6e2f1d] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:39:56.016063 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-90be3087-65bd-447a-81a8-9a374297cebc tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:56.016553 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-90be3087-65bd-447a-81a8-9a374297cebc tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:56.017331 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-90be3087-65bd-447a-81a8-9a374297cebc tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:56.017772 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-90be3087-65bd-447a-81a8-9a374297cebc tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:56.149237 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-90be3087-65bd-447a-81a8-9a374297cebc tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd800b8efe792477bac3ca063920a4a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd7cee3f5704d01ae9df6d300b30004', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:39:56.156635 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-90be3087-65bd-447a-81a8-9a374297cebc tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] 10.222.0.85 "GET /compute/v2.1/servers/af1af1be-6244-4c4f-ac6a-918ace6e2f1d" status: 200 len: 1315 microversion: 2.1 time: 0.152163 Jun 07 14:39:56.157199 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 58/111] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:39:56 2022] GET /compute/v2.1/servers/af1af1be-6244-4c4f-ac6a-918ace6e2f1d => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:39:56.493901 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-376bb1ae-4d04-48eb-9a58-7f29673e3ad9 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:56.494505 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-376bb1ae-4d04-48eb-9a58-7f29673e3ad9 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: ee2e782c-42ff-4093-9246-75d4e69929b3] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:39:56.500512 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-376bb1ae-4d04-48eb-9a58-7f29673e3ad9 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:56.500956 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-376bb1ae-4d04-48eb-9a58-7f29673e3ad9 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:56.501735 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-376bb1ae-4d04-48eb-9a58-7f29673e3ad9 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:56.502173 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-376bb1ae-4d04-48eb-9a58-7f29673e3ad9 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:56.635168 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-376bb1ae-4d04-48eb-9a58-7f29673e3ad9 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:39:56.643007 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-376bb1ae-4d04-48eb-9a58-7f29673e3ad9 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3" status: 200 len: 1319 microversion: 2.1 time: 0.152951 Jun 07 14:39:56.643562 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 54/112] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:39:56 2022] GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:39:56.677061 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-71e77fd1-3b1c-4e2e-a5ce-26668712ea5e tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:56.677670 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-71e77fd1-3b1c-4e2e-a5ce-26668712ea5e tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:39:56.683636 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-71e77fd1-3b1c-4e2e-a5ce-26668712ea5e tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:56.684082 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-71e77fd1-3b1c-4e2e-a5ce-26668712ea5e tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:56.684874 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-71e77fd1-3b1c-4e2e-a5ce-26668712ea5e tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:56.685314 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-71e77fd1-3b1c-4e2e-a5ce-26668712ea5e tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:56.817953 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-71e77fd1-3b1c-4e2e-a5ce-26668712ea5e tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb4b0cf5f8b4274b787f327793964f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ba26b86c7243dab8e6c6b84ed674e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:39:56.825082 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-7c18fc3a-9dd4-4c48-adef-5f799eeb896e tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:56.825825 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-7c18fc3a-9dd4-4c48-adef-5f799eeb896e tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 314a1177-9252-4a27-8c30-0b7af796d9a5] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:39:56.832112 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-71e77fd1-3b1c-4e2e-a5ce-26668712ea5e tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6" status: 200 len: 1363 microversion: 2.1 time: 0.152859 Jun 07 14:39:56.832580 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-7c18fc3a-9dd4-4c48-adef-5f799eeb896e tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:56.833206 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-7c18fc3a-9dd4-4c48-adef-5f799eeb896e tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:56.834035 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-7c18fc3a-9dd4-4c48-adef-5f799eeb896e tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:56.834542 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-7c18fc3a-9dd4-4c48-adef-5f799eeb896e tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:56.836112 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 59/113] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:39:56 2022] GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:39:56.962294 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-7c18fc3a-9dd4-4c48-adef-5f799eeb896e tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eb9ec1f3ff44bbb03cf934cb2a04de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eae64ee53144e4f8d583bb4288c0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:39:56.970285 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-7c18fc3a-9dd4-4c48-adef-5f799eeb896e tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/314a1177-9252-4a27-8c30-0b7af796d9a5" status: 200 len: 1367 microversion: 2.1 time: 0.148977 Jun 07 14:39:56.970843 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 55/114] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:39:56 2022] GET /compute/v2.1/servers/314a1177-9252-4a27-8c30-0b7af796d9a5 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:39:57.173306 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-3946e5b2-855c-44d3-a935-d21dcd11fb30 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:57.173909 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-3946e5b2-855c-44d3-a935-d21dcd11fb30 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] [instance: af1af1be-6244-4c4f-ac6a-918ace6e2f1d] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:39:57.179859 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-3946e5b2-855c-44d3-a935-d21dcd11fb30 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:57.180300 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-3946e5b2-855c-44d3-a935-d21dcd11fb30 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:57.181079 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-3946e5b2-855c-44d3-a935-d21dcd11fb30 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:57.181519 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-3946e5b2-855c-44d3-a935-d21dcd11fb30 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:57.308665 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-3946e5b2-855c-44d3-a935-d21dcd11fb30 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd800b8efe792477bac3ca063920a4a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd7cee3f5704d01ae9df6d300b30004', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:39:57.316715 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-3946e5b2-855c-44d3-a935-d21dcd11fb30 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] 10.222.0.85 "GET /compute/v2.1/servers/af1af1be-6244-4c4f-ac6a-918ace6e2f1d" status: 200 len: 1315 microversion: 2.1 time: 0.147248 Jun 07 14:39:57.317280 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 60/115] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:39:57 2022] GET /compute/v2.1/servers/af1af1be-6244-4c4f-ac6a-918ace6e2f1d => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:39:57.660919 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-fb594ada-fa8e-4830-938d-75c09844a696 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:57.662106 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-fb594ada-fa8e-4830-938d-75c09844a696 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: ee2e782c-42ff-4093-9246-75d4e69929b3] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:39:57.670392 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-fb594ada-fa8e-4830-938d-75c09844a696 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:57.674118 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-fb594ada-fa8e-4830-938d-75c09844a696 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:57.674118 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-fb594ada-fa8e-4830-938d-75c09844a696 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:57.674118 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-fb594ada-fa8e-4830-938d-75c09844a696 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:57.843784 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-b9cae228-3e5a-49af-8c43-0361735ed358 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:57.845436 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-b9cae228-3e5a-49af-8c43-0361735ed358 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:39:57.851704 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-b9cae228-3e5a-49af-8c43-0361735ed358 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:57.853311 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-b9cae228-3e5a-49af-8c43-0361735ed358 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:57.855256 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-b9cae228-3e5a-49af-8c43-0361735ed358 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:57.855871 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-b9cae228-3e5a-49af-8c43-0361735ed358 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:57.984717 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-fb594ada-fa8e-4830-938d-75c09844a696 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:39:57.992923 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-fb594ada-fa8e-4830-938d-75c09844a696 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3" status: 200 len: 1319 microversion: 2.1 time: 0.337246 Jun 07 14:39:57.994517 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 56/116] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:39:57 2022] GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3 => generated 1319 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:39:57.999489 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-ddbd2a07-afff-43b1-bcdd-618f39953f9c tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:58.001694 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-ddbd2a07-afff-43b1-bcdd-618f39953f9c tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 314a1177-9252-4a27-8c30-0b7af796d9a5] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:39:58.009745 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-ddbd2a07-afff-43b1-bcdd-618f39953f9c tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:58.010692 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-ddbd2a07-afff-43b1-bcdd-618f39953f9c tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:58.011946 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-ddbd2a07-afff-43b1-bcdd-618f39953f9c tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:58.013807 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-ddbd2a07-afff-43b1-bcdd-618f39953f9c tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:58.220188 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-ddbd2a07-afff-43b1-bcdd-618f39953f9c tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eb9ec1f3ff44bbb03cf934cb2a04de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eae64ee53144e4f8d583bb4288c0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:39:58.238737 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-ddbd2a07-afff-43b1-bcdd-618f39953f9c tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/314a1177-9252-4a27-8c30-0b7af796d9a5" status: 200 len: 1367 microversion: 2.1 time: 0.242850 Jun 07 14:39:58.241341 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 57/117] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:39:57 2022] GET /compute/v2.1/servers/314a1177-9252-4a27-8c30-0b7af796d9a5 => generated 1367 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:39:58.335610 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-e8d89aee-4bc0-4b3d-860e-7aba692ef42f tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:58.337426 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-e8d89aee-4bc0-4b3d-860e-7aba692ef42f tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] [instance: af1af1be-6244-4c4f-ac6a-918ace6e2f1d] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:39:58.346613 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-e8d89aee-4bc0-4b3d-860e-7aba692ef42f tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:58.347809 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-e8d89aee-4bc0-4b3d-860e-7aba692ef42f tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:58.348872 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-e8d89aee-4bc0-4b3d-860e-7aba692ef42f tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:58.349532 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-e8d89aee-4bc0-4b3d-860e-7aba692ef42f tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:58.439760 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-b9cae228-3e5a-49af-8c43-0361735ed358 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb4b0cf5f8b4274b787f327793964f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ba26b86c7243dab8e6c6b84ed674e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:39:58.447489 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-b9cae228-3e5a-49af-8c43-0361735ed358 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6" status: 200 len: 1363 microversion: 2.1 time: 0.607504 Jun 07 14:39:58.457419 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 61/118] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:39:57 2022] GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 => generated 1363 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:39:58.665446 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [req-0d17a487-cae7-4e57-900c-f1518e956da5 req-25046262-8b23-49aa-9400-4e415f694ee4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af1af1be-6244-4c4f-ac6a-918ace6e2f1d", "name": "network-vif-plugged", "status": "completed", "tag": "a2f1eff0-8cba-4052-b98d-94d3f0238a13"}]} {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:39:58.671125 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-e8d89aee-4bc0-4b3d-860e-7aba692ef42f tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd800b8efe792477bac3ca063920a4a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd7cee3f5704d01ae9df6d300b30004', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:39:58.683072 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-e8d89aee-4bc0-4b3d-860e-7aba692ef42f tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] 10.222.0.85 "GET /compute/v2.1/servers/af1af1be-6244-4c4f-ac6a-918ace6e2f1d" status: 200 len: 1315 microversion: 2.1 time: 0.352784 Jun 07 14:39:58.684262 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 58/119] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:39:58 2022] GET /compute/v2.1/servers/af1af1be-6244-4c4f-ac6a-918ace6e2f1d => generated 1315 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:39:58.684410 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [req-0d17a487-cae7-4e57-900c-f1518e956da5 req-25046262-8b23-49aa-9400-4e415f694ee4 service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:58.684986 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [req-0d17a487-cae7-4e57-900c-f1518e956da5 req-25046262-8b23-49aa-9400-4e415f694ee4 service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:58.699140 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG dbcounter [-] [118158] Writing DB stats nova_cell1:SELECT=100 {{(pid=118158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:39:58.720812 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.compute.server_external_events [req-0d17a487-cae7-4e57-900c-f1518e956da5 req-25046262-8b23-49aa-9400-4e415f694ee4 service nova] Creating event network-vif-plugged:a2f1eff0-8cba-4052-b98d-94d3f0238a13 for instance af1af1be-6244-4c4f-ac6a-918ace6e2f1d on hv-cinder-84497 Jun 07 14:39:58.730292 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [req-0d17a487-cae7-4e57-900c-f1518e956da5 req-25046262-8b23-49aa-9400-4e415f694ee4 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.158134 Jun 07 14:39:58.732431 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 62/120] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jun 7 14:39:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 14:39:59.020884 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-941ae755-e313-4173-b913-bc451c59d223 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:59.021733 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-941ae755-e313-4173-b913-bc451c59d223 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: ee2e782c-42ff-4093-9246-75d4e69929b3] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:39:59.030452 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-941ae755-e313-4173-b913-bc451c59d223 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:59.031071 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-941ae755-e313-4173-b913-bc451c59d223 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:59.032035 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-941ae755-e313-4173-b913-bc451c59d223 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:59.032644 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-941ae755-e313-4173-b913-bc451c59d223 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:59.253257 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG dbcounter [-] [118158] Writing DB stats nova_cell0:SELECT=4 {{(pid=118158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:39:59.258429 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-d5103c6f-c962-4072-8812-3ba59cd7075b tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:59.259157 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-d5103c6f-c962-4072-8812-3ba59cd7075b tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 314a1177-9252-4a27-8c30-0b7af796d9a5] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:39:59.277541 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-d5103c6f-c962-4072-8812-3ba59cd7075b tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:59.278003 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-d5103c6f-c962-4072-8812-3ba59cd7075b tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:59.278793 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-d5103c6f-c962-4072-8812-3ba59cd7075b tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:59.279235 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-d5103c6f-c962-4072-8812-3ba59cd7075b tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:59.524498 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-941ae755-e313-4173-b913-bc451c59d223 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:39:59.538948 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-941ae755-e313-4173-b913-bc451c59d223 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3" status: 200 len: 1319 microversion: 2.1 time: 0.530180 Jun 07 14:39:59.539831 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 59/121] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:39:59 2022] GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3 => generated 1319 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:39:59.544724 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-bfb183e4-57cb-43f6-a646-a18574e94b76 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:59.545567 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-bfb183e4-57cb-43f6-a646-a18574e94b76 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:39:59.553678 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-bfb183e4-57cb-43f6-a646-a18574e94b76 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:59.554366 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-bfb183e4-57cb-43f6-a646-a18574e94b76 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:59.555300 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-bfb183e4-57cb-43f6-a646-a18574e94b76 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:59.556532 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-bfb183e4-57cb-43f6-a646-a18574e94b76 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:59.663309 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-d5103c6f-c962-4072-8812-3ba59cd7075b tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eb9ec1f3ff44bbb03cf934cb2a04de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eae64ee53144e4f8d583bb4288c0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:39:59.680029 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-d5103c6f-c962-4072-8812-3ba59cd7075b tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/314a1177-9252-4a27-8c30-0b7af796d9a5" status: 200 len: 1367 microversion: 2.1 time: 0.427371 Jun 07 14:39:59.681451 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 63/122] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:39:59 2022] GET /compute/v2.1/servers/314a1177-9252-4a27-8c30-0b7af796d9a5 => generated 1367 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:39:59.857941 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [req-3ea108f4-fd84-422a-9aee-3ba1798ce093 req-d6855bc2-7161-4035-be2c-c24fd3f8af04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "314a1177-9252-4a27-8c30-0b7af796d9a5", "tag": "8997ff45-6df9-4130-98b4-85dfcdb44008"}]} {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:39:59.888026 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [req-3ea108f4-fd84-422a-9aee-3ba1798ce093 req-d6855bc2-7161-4035-be2c-c24fd3f8af04 service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:39:59.893114 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [req-3ea108f4-fd84-422a-9aee-3ba1798ce093 req-d6855bc2-7161-4035-be2c-c24fd3f8af04 service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:39:59.948000 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.compute.server_external_events [req-3ea108f4-fd84-422a-9aee-3ba1798ce093 req-d6855bc2-7161-4035-be2c-c24fd3f8af04 service nova] Creating event network-changed:8997ff45-6df9-4130-98b4-85dfcdb44008 for instance 314a1177-9252-4a27-8c30-0b7af796d9a5 on hv-cinder-84497 Jun 07 14:39:59.957843 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [req-3ea108f4-fd84-422a-9aee-3ba1798ce093 req-d6855bc2-7161-4035-be2c-c24fd3f8af04 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.274595 Jun 07 14:39:59.960775 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 64/123] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jun 7 14:39:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:39:59.970109 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-4b73e109-4be3-44e2-9bd2-629f84733e4c tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:39:59.972138 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-4b73e109-4be3-44e2-9bd2-629f84733e4c tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] [instance: af1af1be-6244-4c4f-ac6a-918ace6e2f1d] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:39:59.998186 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-4b73e109-4be3-44e2-9bd2-629f84733e4c tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:00.002627 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-4b73e109-4be3-44e2-9bd2-629f84733e4c tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:00.006687 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-4b73e109-4be3-44e2-9bd2-629f84733e4c tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:00.008260 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-4b73e109-4be3-44e2-9bd2-629f84733e4c tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:00.194279 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-bfb183e4-57cb-43f6-a646-a18574e94b76 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb4b0cf5f8b4274b787f327793964f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ba26b86c7243dab8e6c6b84ed674e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:40:00.212766 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-bfb183e4-57cb-43f6-a646-a18574e94b76 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6" status: 200 len: 1363 microversion: 2.1 time: 0.671538 Jun 07 14:40:00.218057 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 60/124] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:39:59 2022] GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 => generated 1363 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:40:00.234403 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [req-14436838-d3d8-4dc5-af52-926c33cd2e80 req-a7cc309a-bfc1-4bff-9dfa-65a7b4338cbd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee2e782c-42ff-4093-9246-75d4e69929b3", "tag": "459067e8-6ae6-4176-ac6a-fa525305f17b"}]} {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:40:00.265053 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [req-14436838-d3d8-4dc5-af52-926c33cd2e80 req-a7cc309a-bfc1-4bff-9dfa-65a7b4338cbd service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:00.265511 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [req-14436838-d3d8-4dc5-af52-926c33cd2e80 req-a7cc309a-bfc1-4bff-9dfa-65a7b4338cbd service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:00.299692 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.compute.server_external_events [req-14436838-d3d8-4dc5-af52-926c33cd2e80 req-a7cc309a-bfc1-4bff-9dfa-65a7b4338cbd service nova] Creating event network-changed:459067e8-6ae6-4176-ac6a-fa525305f17b for instance ee2e782c-42ff-4093-9246-75d4e69929b3 on hv-cinder-84497 Jun 07 14:40:00.316483 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [req-14436838-d3d8-4dc5-af52-926c33cd2e80 req-a7cc309a-bfc1-4bff-9dfa-65a7b4338cbd service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094724 Jun 07 14:40:00.321672 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 61/125] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jun 7 14:40:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:40:00.481612 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-4b73e109-4be3-44e2-9bd2-629f84733e4c tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd800b8efe792477bac3ca063920a4a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd7cee3f5704d01ae9df6d300b30004', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:40:00.491575 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-4b73e109-4be3-44e2-9bd2-629f84733e4c tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] 10.222.0.85 "GET /compute/v2.1/servers/af1af1be-6244-4c4f-ac6a-918ace6e2f1d" status: 200 len: 1315 microversion: 2.1 time: 0.528069 Jun 07 14:40:00.492253 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 65/126] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:39:59 2022] GET /compute/v2.1/servers/af1af1be-6244-4c4f-ac6a-918ace6e2f1d => generated 1315 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:40:00.556522 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-fbcbd88c-0079-486c-9f16-54a21b313419 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:40:00.557412 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-fbcbd88c-0079-486c-9f16-54a21b313419 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: ee2e782c-42ff-4093-9246-75d4e69929b3] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:40:00.563565 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-fbcbd88c-0079-486c-9f16-54a21b313419 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:00.564402 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-fbcbd88c-0079-486c-9f16-54a21b313419 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:00.564863 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-fbcbd88c-0079-486c-9f16-54a21b313419 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:00.565305 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-fbcbd88c-0079-486c-9f16-54a21b313419 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:00.705912 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-c4115a3e-1eb4-4bc7-a1c7-86387d63791d tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:40:00.706587 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-c4115a3e-1eb4-4bc7-a1c7-86387d63791d tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 314a1177-9252-4a27-8c30-0b7af796d9a5] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:40:00.712232 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-fbcbd88c-0079-486c-9f16-54a21b313419 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:40:00.714037 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-c4115a3e-1eb4-4bc7-a1c7-86387d63791d tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:00.714563 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-c4115a3e-1eb4-4bc7-a1c7-86387d63791d tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:00.715456 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-c4115a3e-1eb4-4bc7-a1c7-86387d63791d tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:00.716007 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-c4115a3e-1eb4-4bc7-a1c7-86387d63791d tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:00.721221 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-fbcbd88c-0079-486c-9f16-54a21b313419 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3" status: 200 len: 1319 microversion: 2.1 time: 0.168700 Jun 07 14:40:00.721531 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 62/127] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:40:00 2022] GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:40:00.996517 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-c4115a3e-1eb4-4bc7-a1c7-86387d63791d tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eb9ec1f3ff44bbb03cf934cb2a04de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eae64ee53144e4f8d583bb4288c0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:40:01.004450 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-c4115a3e-1eb4-4bc7-a1c7-86387d63791d tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/314a1177-9252-4a27-8c30-0b7af796d9a5" status: 200 len: 1367 microversion: 2.1 time: 0.303136 Jun 07 14:40:01.004999 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 66/128] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:40:00 2022] GET /compute/v2.1/servers/314a1177-9252-4a27-8c30-0b7af796d9a5 => generated 1367 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:40:01.246641 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-f4f7da97-4afa-40ac-8dcf-de68d4065c16 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:40:01.246641 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-f4f7da97-4afa-40ac-8dcf-de68d4065c16 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:40:01.248252 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-f4f7da97-4afa-40ac-8dcf-de68d4065c16 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:01.249242 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-f4f7da97-4afa-40ac-8dcf-de68d4065c16 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:01.250057 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-f4f7da97-4afa-40ac-8dcf-de68d4065c16 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:01.250536 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-f4f7da97-4afa-40ac-8dcf-de68d4065c16 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:01.407858 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-f4f7da97-4afa-40ac-8dcf-de68d4065c16 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb4b0cf5f8b4274b787f327793964f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ba26b86c7243dab8e6c6b84ed674e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:40:01.415389 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-f4f7da97-4afa-40ac-8dcf-de68d4065c16 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6" status: 200 len: 1363 microversion: 2.1 time: 0.178974 Jun 07 14:40:01.416122 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 63/129] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:40:01 2022] GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 => generated 1363 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:40:01.510300 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-6b471bae-f40c-4d44-ba14-795348394f55 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:40:01.510926 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-6b471bae-f40c-4d44-ba14-795348394f55 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] [instance: af1af1be-6244-4c4f-ac6a-918ace6e2f1d] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:40:01.525895 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-6b471bae-f40c-4d44-ba14-795348394f55 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:01.526350 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-6b471bae-f40c-4d44-ba14-795348394f55 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:01.527164 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-6b471bae-f40c-4d44-ba14-795348394f55 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:01.527605 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-6b471bae-f40c-4d44-ba14-795348394f55 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:01.658731 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-6b471bae-f40c-4d44-ba14-795348394f55 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd800b8efe792477bac3ca063920a4a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd7cee3f5704d01ae9df6d300b30004', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:40:01.674512 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-6b471bae-f40c-4d44-ba14-795348394f55 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] 10.222.0.85 "GET /compute/v2.1/servers/af1af1be-6244-4c4f-ac6a-918ace6e2f1d" status: 200 len: 1315 microversion: 2.1 time: 0.168171 Jun 07 14:40:01.675083 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 67/130] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:40:01 2022] GET /compute/v2.1/servers/af1af1be-6244-4c4f-ac6a-918ace6e2f1d => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:40:01.740033 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-9ed32902-dcc4-4103-ad70-6f0abb0abe3a tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:40:01.743167 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-9ed32902-dcc4-4103-ad70-6f0abb0abe3a tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: ee2e782c-42ff-4093-9246-75d4e69929b3] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:40:01.751624 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-9ed32902-dcc4-4103-ad70-6f0abb0abe3a tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:01.752117 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-9ed32902-dcc4-4103-ad70-6f0abb0abe3a tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:01.752912 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-9ed32902-dcc4-4103-ad70-6f0abb0abe3a tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:01.753346 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-9ed32902-dcc4-4103-ad70-6f0abb0abe3a tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:01.903882 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-9ed32902-dcc4-4103-ad70-6f0abb0abe3a tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:40:01.923080 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-9ed32902-dcc4-4103-ad70-6f0abb0abe3a tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3" status: 200 len: 1319 microversion: 2.1 time: 0.188192 Jun 07 14:40:01.923655 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 64/131] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:40:01 2022] GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3 => generated 1319 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:40:02.021852 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-63e4f90d-c22e-4e7c-8b17-5366a758fcab tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:40:02.022477 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-63e4f90d-c22e-4e7c-8b17-5366a758fcab tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 314a1177-9252-4a27-8c30-0b7af796d9a5] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:40:02.028593 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-63e4f90d-c22e-4e7c-8b17-5366a758fcab tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:02.029045 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-63e4f90d-c22e-4e7c-8b17-5366a758fcab tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:02.030331 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-63e4f90d-c22e-4e7c-8b17-5366a758fcab tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:02.030778 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-63e4f90d-c22e-4e7c-8b17-5366a758fcab tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:02.161592 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-63e4f90d-c22e-4e7c-8b17-5366a758fcab tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eb9ec1f3ff44bbb03cf934cb2a04de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eae64ee53144e4f8d583bb4288c0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:40:02.169054 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-63e4f90d-c22e-4e7c-8b17-5366a758fcab tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/314a1177-9252-4a27-8c30-0b7af796d9a5" status: 200 len: 1367 microversion: 2.1 time: 0.151297 Jun 07 14:40:02.169608 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 68/132] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:40:02 2022] GET /compute/v2.1/servers/314a1177-9252-4a27-8c30-0b7af796d9a5 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:40:02.397081 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [req-8b609bdc-096d-48e3-9b6e-b81a2b776e45 req-ab5c44b6-d0f4-4de9-bb96-8f01c1d6434c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6", "tag": "0846b81f-bd2c-4547-87e2-dc3a37931c85"}]} {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:40:02.406809 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [req-8b609bdc-096d-48e3-9b6e-b81a2b776e45 req-ab5c44b6-d0f4-4de9-bb96-8f01c1d6434c service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:02.407226 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [req-8b609bdc-096d-48e3-9b6e-b81a2b776e45 req-ab5c44b6-d0f4-4de9-bb96-8f01c1d6434c service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:02.418899 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.compute.server_external_events [req-8b609bdc-096d-48e3-9b6e-b81a2b776e45 req-ab5c44b6-d0f4-4de9-bb96-8f01c1d6434c service nova] Creating event network-changed:0846b81f-bd2c-4547-87e2-dc3a37931c85 for instance e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 on hv-cinder-84497 Jun 07 14:40:02.424040 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [req-8b609bdc-096d-48e3-9b6e-b81a2b776e45 req-ab5c44b6-d0f4-4de9-bb96-8f01c1d6434c service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030812 Jun 07 14:40:02.424901 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 65/133] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jun 7 14:40:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 14:40:02.433144 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-ccbd8e03-9856-4ce0-b430-ae50778a6513 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:40:02.433761 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-ccbd8e03-9856-4ce0-b430-ae50778a6513 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:40:02.440297 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-ccbd8e03-9856-4ce0-b430-ae50778a6513 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:02.440771 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-ccbd8e03-9856-4ce0-b430-ae50778a6513 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:02.441545 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-ccbd8e03-9856-4ce0-b430-ae50778a6513 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:02.441989 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-ccbd8e03-9856-4ce0-b430-ae50778a6513 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:02.634665 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-ccbd8e03-9856-4ce0-b430-ae50778a6513 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb4b0cf5f8b4274b787f327793964f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ba26b86c7243dab8e6c6b84ed674e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:40:02.644913 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-ccbd8e03-9856-4ce0-b430-ae50778a6513 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6" status: 200 len: 1363 microversion: 2.1 time: 0.215993 Jun 07 14:40:02.645490 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 69/134] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:40:02 2022] GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 => generated 1363 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:40:02.692068 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-f40b9029-1042-4150-aef2-19b4f7f5f0c1 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:40:02.693436 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-f40b9029-1042-4150-aef2-19b4f7f5f0c1 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] [instance: af1af1be-6244-4c4f-ac6a-918ace6e2f1d] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:40:02.701596 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-f40b9029-1042-4150-aef2-19b4f7f5f0c1 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:02.702660 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-f40b9029-1042-4150-aef2-19b4f7f5f0c1 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:02.708511 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-f40b9029-1042-4150-aef2-19b4f7f5f0c1 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:02.708511 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-f40b9029-1042-4150-aef2-19b4f7f5f0c1 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:02.882589 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-f40b9029-1042-4150-aef2-19b4f7f5f0c1 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd800b8efe792477bac3ca063920a4a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd7cee3f5704d01ae9df6d300b30004', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:40:02.891429 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [req-aa6abd5c-a35c-4261-8b1a-ca29962f2261 req-e56ef180-f4cf-47b9-933b-a44c58435f0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45f65f98-e1ca-4e07-872a-ef0403e2d50a", "name": "network-vif-plugged", "status": "completed", "tag": "568ba600-2682-4efd-8fd6-ca711d30e17a"}]} {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:40:02.906309 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-f40b9029-1042-4150-aef2-19b4f7f5f0c1 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] 10.222.0.85 "GET /compute/v2.1/servers/af1af1be-6244-4c4f-ac6a-918ace6e2f1d" status: 200 len: 1315 microversion: 2.1 time: 0.215658 Jun 07 14:40:02.908469 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [req-aa6abd5c-a35c-4261-8b1a-ca29962f2261 req-e56ef180-f4cf-47b9-933b-a44c58435f0f service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:02.908924 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [req-aa6abd5c-a35c-4261-8b1a-ca29962f2261 req-e56ef180-f4cf-47b9-933b-a44c58435f0f service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:02.911497 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 66/135] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:40:02 2022] GET /compute/v2.1/servers/af1af1be-6244-4c4f-ac6a-918ace6e2f1d => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:40:02.927754 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.compute.server_external_events [req-aa6abd5c-a35c-4261-8b1a-ca29962f2261 req-e56ef180-f4cf-47b9-933b-a44c58435f0f service nova] Creating event network-vif-plugged:568ba600-2682-4efd-8fd6-ca711d30e17a for instance 45f65f98-e1ca-4e07-872a-ef0403e2d50a on hv-cinder-84497 Jun 07 14:40:02.933042 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [req-aa6abd5c-a35c-4261-8b1a-ca29962f2261 req-e56ef180-f4cf-47b9-933b-a44c58435f0f service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045982 Jun 07 14:40:02.935561 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 70/136] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jun 7 14:40:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:40:02.943722 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-74ef94d9-f715-465e-8e3a-ba6746f453e1 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:40:02.943722 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-74ef94d9-f715-465e-8e3a-ba6746f453e1 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: ee2e782c-42ff-4093-9246-75d4e69929b3] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:40:02.947964 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-74ef94d9-f715-465e-8e3a-ba6746f453e1 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:02.948772 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-74ef94d9-f715-465e-8e3a-ba6746f453e1 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:02.949825 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-74ef94d9-f715-465e-8e3a-ba6746f453e1 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:02.950530 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-74ef94d9-f715-465e-8e3a-ba6746f453e1 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:03.114065 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-74ef94d9-f715-465e-8e3a-ba6746f453e1 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:40:03.121998 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-74ef94d9-f715-465e-8e3a-ba6746f453e1 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3" status: 200 len: 1319 microversion: 2.1 time: 0.185538 Jun 07 14:40:03.123203 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 67/137] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:40:02 2022] GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3 => generated 1319 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:40:03.189030 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-9a72e0e0-b01b-45a1-8fea-e1fa8151bb5f tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:40:03.190556 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-9a72e0e0-b01b-45a1-8fea-e1fa8151bb5f tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 314a1177-9252-4a27-8c30-0b7af796d9a5] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:40:03.197534 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-9a72e0e0-b01b-45a1-8fea-e1fa8151bb5f tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:03.197994 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-9a72e0e0-b01b-45a1-8fea-e1fa8151bb5f tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:03.198792 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-9a72e0e0-b01b-45a1-8fea-e1fa8151bb5f tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:03.199232 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-9a72e0e0-b01b-45a1-8fea-e1fa8151bb5f tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:03.363947 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-9a72e0e0-b01b-45a1-8fea-e1fa8151bb5f tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eb9ec1f3ff44bbb03cf934cb2a04de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eae64ee53144e4f8d583bb4288c0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:40:03.371524 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-9a72e0e0-b01b-45a1-8fea-e1fa8151bb5f tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/314a1177-9252-4a27-8c30-0b7af796d9a5" status: 200 len: 1367 microversion: 2.1 time: 0.189865 Jun 07 14:40:03.372171 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 71/138] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:40:03 2022] GET /compute/v2.1/servers/314a1177-9252-4a27-8c30-0b7af796d9a5 => generated 1367 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:40:03.662051 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-8b5ff794-31e5-4f8a-b531-d4b175d209dc tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:40:03.662818 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-8b5ff794-31e5-4f8a-b531-d4b175d209dc tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:40:03.668721 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-8b5ff794-31e5-4f8a-b531-d4b175d209dc tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:03.669178 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-8b5ff794-31e5-4f8a-b531-d4b175d209dc tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:03.669944 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-8b5ff794-31e5-4f8a-b531-d4b175d209dc tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:03.670380 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-8b5ff794-31e5-4f8a-b531-d4b175d209dc tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:03.693909 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG dbcounter [-] [118157] Writing DB stats nova_cell1:SELECT=100 {{(pid=118157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:40:03.811291 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-8b5ff794-31e5-4f8a-b531-d4b175d209dc tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb4b0cf5f8b4274b787f327793964f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ba26b86c7243dab8e6c6b84ed674e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:40:03.818831 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-8b5ff794-31e5-4f8a-b531-d4b175d209dc tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6" status: 200 len: 1363 microversion: 2.1 time: 0.160808 Jun 07 14:40:03.819386 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 68/139] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:40:03 2022] GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:40:03.927747 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-eb81abe8-c16c-4cc4-8021-f4783d28b298 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:40:03.928365 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-eb81abe8-c16c-4cc4-8021-f4783d28b298 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] [instance: af1af1be-6244-4c4f-ac6a-918ace6e2f1d] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:40:03.934559 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-eb81abe8-c16c-4cc4-8021-f4783d28b298 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:03.935521 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-eb81abe8-c16c-4cc4-8021-f4783d28b298 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:03.942603 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-eb81abe8-c16c-4cc4-8021-f4783d28b298 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:03.942603 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-eb81abe8-c16c-4cc4-8021-f4783d28b298 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:04.141046 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-8b51003b-f5df-46ba-8eaf-2286bf0ff86a tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:40:04.141792 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-8b51003b-f5df-46ba-8eaf-2286bf0ff86a tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: ee2e782c-42ff-4093-9246-75d4e69929b3] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:40:04.148197 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-8b51003b-f5df-46ba-8eaf-2286bf0ff86a tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:04.148988 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-8b51003b-f5df-46ba-8eaf-2286bf0ff86a tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:04.150183 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-8b51003b-f5df-46ba-8eaf-2286bf0ff86a tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:04.150707 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-8b51003b-f5df-46ba-8eaf-2286bf0ff86a tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:04.219167 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-eb81abe8-c16c-4cc4-8021-f4783d28b298 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd800b8efe792477bac3ca063920a4a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd7cee3f5704d01ae9df6d300b30004', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:40:04.227536 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-eb81abe8-c16c-4cc4-8021-f4783d28b298 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] 10.222.0.85 "GET /compute/v2.1/servers/af1af1be-6244-4c4f-ac6a-918ace6e2f1d" status: 200 len: 1315 microversion: 2.1 time: 0.303815 Jun 07 14:40:04.228344 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 72/140] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:40:03 2022] GET /compute/v2.1/servers/af1af1be-6244-4c4f-ac6a-918ace6e2f1d => generated 1315 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:40:04.325195 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-8b51003b-f5df-46ba-8eaf-2286bf0ff86a tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:40:04.335632 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-8b51003b-f5df-46ba-8eaf-2286bf0ff86a tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3" status: 200 len: 1319 microversion: 2.1 time: 0.199404 Jun 07 14:40:04.336471 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 69/141] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:40:04 2022] GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3 => generated 1319 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:40:04.388820 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-12be2070-8c12-40e4-83ba-7b859de737f8 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:40:04.389587 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-12be2070-8c12-40e4-83ba-7b859de737f8 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 314a1177-9252-4a27-8c30-0b7af796d9a5] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:40:04.400908 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-12be2070-8c12-40e4-83ba-7b859de737f8 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:04.401366 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-12be2070-8c12-40e4-83ba-7b859de737f8 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:04.402156 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-12be2070-8c12-40e4-83ba-7b859de737f8 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:04.402685 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-12be2070-8c12-40e4-83ba-7b859de737f8 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:04.846194 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-02a3bed0-a673-4111-8c3e-41260153449a tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:40:04.846194 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-02a3bed0-a673-4111-8c3e-41260153449a tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:40:04.848747 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-02a3bed0-a673-4111-8c3e-41260153449a tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:04.849202 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-02a3bed0-a673-4111-8c3e-41260153449a tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:04.850022 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-02a3bed0-a673-4111-8c3e-41260153449a tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:04.850461 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-02a3bed0-a673-4111-8c3e-41260153449a tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:05.051845 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-12be2070-8c12-40e4-83ba-7b859de737f8 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eb9ec1f3ff44bbb03cf934cb2a04de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eae64ee53144e4f8d583bb4288c0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:40:05.061700 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-12be2070-8c12-40e4-83ba-7b859de737f8 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/314a1177-9252-4a27-8c30-0b7af796d9a5" status: 200 len: 1367 microversion: 2.1 time: 0.676918 Jun 07 14:40:05.076129 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 73/142] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:40:04 2022] GET /compute/v2.1/servers/314a1177-9252-4a27-8c30-0b7af796d9a5 => generated 1367 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:40:05.199713 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-02a3bed0-a673-4111-8c3e-41260153449a tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb4b0cf5f8b4274b787f327793964f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ba26b86c7243dab8e6c6b84ed674e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:40:05.218321 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-02a3bed0-a673-4111-8c3e-41260153449a tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6" status: 200 len: 1363 microversion: 2.1 time: 0.385237 Jun 07 14:40:05.219988 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 70/143] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:40:04 2022] GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 => generated 1363 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:40:05.247601 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-33660c4b-b2bd-48ce-ad9f-c447cf2da04a tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:40:05.248792 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-33660c4b-b2bd-48ce-ad9f-c447cf2da04a tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] [instance: af1af1be-6244-4c4f-ac6a-918ace6e2f1d] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:40:05.275145 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-33660c4b-b2bd-48ce-ad9f-c447cf2da04a tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:05.275976 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-33660c4b-b2bd-48ce-ad9f-c447cf2da04a tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:05.278072 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-33660c4b-b2bd-48ce-ad9f-c447cf2da04a tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:05.279252 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-33660c4b-b2bd-48ce-ad9f-c447cf2da04a tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:05.353528 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-421eb328-7513-47e2-9b83-05981be397e1 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:40:05.354463 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-421eb328-7513-47e2-9b83-05981be397e1 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: ee2e782c-42ff-4093-9246-75d4e69929b3] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:40:05.365116 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-421eb328-7513-47e2-9b83-05981be397e1 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:05.368268 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-421eb328-7513-47e2-9b83-05981be397e1 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:05.368268 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-421eb328-7513-47e2-9b83-05981be397e1 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:05.368268 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-421eb328-7513-47e2-9b83-05981be397e1 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:05.447387 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-33660c4b-b2bd-48ce-ad9f-c447cf2da04a tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd800b8efe792477bac3ca063920a4a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd7cee3f5704d01ae9df6d300b30004', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:40:05.455966 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-33660c4b-b2bd-48ce-ad9f-c447cf2da04a tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] 10.222.0.85 "GET /compute/v2.1/servers/af1af1be-6244-4c4f-ac6a-918ace6e2f1d" status: 200 len: 1501 microversion: 2.1 time: 0.215522 Jun 07 14:40:05.460439 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 74/144] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:40:05 2022] GET /compute/v2.1/servers/af1af1be-6244-4c4f-ac6a-918ace6e2f1d => generated 1501 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:40:05.551902 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-421eb328-7513-47e2-9b83-05981be397e1 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:40:05.555400 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-421eb328-7513-47e2-9b83-05981be397e1 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3" status: 200 len: 1319 microversion: 2.1 time: 0.206173 Jun 07 14:40:05.556170 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 71/145] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:40:05 2022] GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3 => generated 1319 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:40:06.078853 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-2bfed99e-10c8-4092-b42b-49d283a2f118 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:40:06.082549 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-2bfed99e-10c8-4092-b42b-49d283a2f118 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 314a1177-9252-4a27-8c30-0b7af796d9a5] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:40:06.085518 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-2bfed99e-10c8-4092-b42b-49d283a2f118 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:06.085970 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-2bfed99e-10c8-4092-b42b-49d283a2f118 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:06.086752 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-2bfed99e-10c8-4092-b42b-49d283a2f118 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:06.087412 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-2bfed99e-10c8-4092-b42b-49d283a2f118 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:06.237940 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-91d4803a-9514-4817-a881-24bdad15ecf9 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:40:06.240781 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-91d4803a-9514-4817-a881-24bdad15ecf9 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:40:06.248014 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-91d4803a-9514-4817-a881-24bdad15ecf9 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:06.252103 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-91d4803a-9514-4817-a881-24bdad15ecf9 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:06.252103 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-91d4803a-9514-4817-a881-24bdad15ecf9 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:06.252103 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-91d4803a-9514-4817-a881-24bdad15ecf9 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:06.278811 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-2bfed99e-10c8-4092-b42b-49d283a2f118 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eb9ec1f3ff44bbb03cf934cb2a04de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eae64ee53144e4f8d583bb4288c0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:40:06.288936 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-2bfed99e-10c8-4092-b42b-49d283a2f118 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/314a1177-9252-4a27-8c30-0b7af796d9a5" status: 200 len: 1367 microversion: 2.1 time: 0.213949 Jun 07 14:40:06.298666 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 75/146] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:40:06 2022] GET /compute/v2.1/servers/314a1177-9252-4a27-8c30-0b7af796d9a5 => generated 1367 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:40:06.411010 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-91d4803a-9514-4817-a881-24bdad15ecf9 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb4b0cf5f8b4274b787f327793964f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ba26b86c7243dab8e6c6b84ed674e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:40:06.419209 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-91d4803a-9514-4817-a881-24bdad15ecf9 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6" status: 200 len: 1363 microversion: 2.1 time: 0.186645 Jun 07 14:40:06.420149 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 72/147] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:40:06 2022] GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 => generated 1363 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:40:06.573401 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-affd8765-1fbe-4222-9674-b3bd86509e66 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:40:06.574200 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-affd8765-1fbe-4222-9674-b3bd86509e66 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: ee2e782c-42ff-4093-9246-75d4e69929b3] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:40:06.582569 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-affd8765-1fbe-4222-9674-b3bd86509e66 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:06.582569 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-affd8765-1fbe-4222-9674-b3bd86509e66 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:06.582852 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-affd8765-1fbe-4222-9674-b3bd86509e66 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:06.583490 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-affd8765-1fbe-4222-9674-b3bd86509e66 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:06.736519 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-affd8765-1fbe-4222-9674-b3bd86509e66 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:40:06.760849 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-affd8765-1fbe-4222-9674-b3bd86509e66 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3" status: 200 len: 1319 microversion: 2.1 time: 0.191413 Jun 07 14:40:06.766034 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 76/148] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:40:06 2022] GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3 => generated 1319 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:40:06.922903 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [req-4d8d3c89-b874-4dd6-9244-bdf54c651379 req-ddbb4068-ec4b-4685-a04e-1d50f4275871 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "314a1177-9252-4a27-8c30-0b7af796d9a5", "name": "network-vif-plugged", "status": "completed", "tag": "8997ff45-6df9-4130-98b4-85dfcdb44008"}]} {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:40:06.931008 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [req-4d8d3c89-b874-4dd6-9244-bdf54c651379 req-ddbb4068-ec4b-4685-a04e-1d50f4275871 service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:06.931452 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [req-4d8d3c89-b874-4dd6-9244-bdf54c651379 req-ddbb4068-ec4b-4685-a04e-1d50f4275871 service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:06.944034 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.compute.server_external_events [req-4d8d3c89-b874-4dd6-9244-bdf54c651379 req-ddbb4068-ec4b-4685-a04e-1d50f4275871 service nova] Creating event network-vif-plugged:8997ff45-6df9-4130-98b4-85dfcdb44008 for instance 314a1177-9252-4a27-8c30-0b7af796d9a5 on hv-cinder-84497 Jun 07 14:40:06.948422 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [req-4d8d3c89-b874-4dd6-9244-bdf54c651379 req-ddbb4068-ec4b-4685-a04e-1d50f4275871 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029384 Jun 07 14:40:06.949217 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 73/149] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jun 7 14:40:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:40:07.310103 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-a7b6fdfe-4616-44e8-b399-19f906b64e23 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:40:07.310727 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-a7b6fdfe-4616-44e8-b399-19f906b64e23 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 314a1177-9252-4a27-8c30-0b7af796d9a5] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:40:07.317589 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-a7b6fdfe-4616-44e8-b399-19f906b64e23 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:07.318046 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-a7b6fdfe-4616-44e8-b399-19f906b64e23 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:07.318829 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-a7b6fdfe-4616-44e8-b399-19f906b64e23 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:07.319267 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-a7b6fdfe-4616-44e8-b399-19f906b64e23 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:07.437293 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-367718ae-5562-4d7a-a618-316f5e48bcfe tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:40:07.443125 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-367718ae-5562-4d7a-a618-316f5e48bcfe tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:40:07.443125 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG dbcounter [-] [118157] Writing DB stats nova_api:SELECT=100 {{(pid=118157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:40:07.444666 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-367718ae-5562-4d7a-a618-316f5e48bcfe tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:07.445122 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-367718ae-5562-4d7a-a618-316f5e48bcfe tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:07.445899 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-367718ae-5562-4d7a-a618-316f5e48bcfe tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:07.446340 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-367718ae-5562-4d7a-a618-316f5e48bcfe tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:07.471630 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-a7b6fdfe-4616-44e8-b399-19f906b64e23 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eb9ec1f3ff44bbb03cf934cb2a04de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eae64ee53144e4f8d583bb4288c0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:40:07.479285 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-a7b6fdfe-4616-44e8-b399-19f906b64e23 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/314a1177-9252-4a27-8c30-0b7af796d9a5" status: 200 len: 1367 microversion: 2.1 time: 0.173014 Jun 07 14:40:07.480974 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 77/150] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:40:07 2022] GET /compute/v2.1/servers/314a1177-9252-4a27-8c30-0b7af796d9a5 => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:40:07.578371 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-367718ae-5562-4d7a-a618-316f5e48bcfe tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb4b0cf5f8b4274b787f327793964f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ba26b86c7243dab8e6c6b84ed674e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:40:07.585928 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-367718ae-5562-4d7a-a618-316f5e48bcfe tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6" status: 200 len: 1363 microversion: 2.1 time: 0.153411 Jun 07 14:40:07.586487 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 74/151] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:40:07 2022] GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:40:07.787054 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-443cc5c9-1ddb-4bd6-82dd-cda9d14aa87e tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:40:07.787728 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-443cc5c9-1ddb-4bd6-82dd-cda9d14aa87e tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: ee2e782c-42ff-4093-9246-75d4e69929b3] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:40:07.793655 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-443cc5c9-1ddb-4bd6-82dd-cda9d14aa87e tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:07.794096 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-443cc5c9-1ddb-4bd6-82dd-cda9d14aa87e tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:07.794860 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-443cc5c9-1ddb-4bd6-82dd-cda9d14aa87e tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:07.796058 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-443cc5c9-1ddb-4bd6-82dd-cda9d14aa87e tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:07.945169 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-443cc5c9-1ddb-4bd6-82dd-cda9d14aa87e tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:40:07.964512 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-443cc5c9-1ddb-4bd6-82dd-cda9d14aa87e tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3" status: 200 len: 1319 microversion: 2.1 time: 0.181267 Jun 07 14:40:07.965125 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 78/152] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:40:07 2022] GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3 => generated 1319 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:40:08.503325 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-914ed270-50f6-4279-a48d-b44d3da3b3eb tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c6b1bf6d-c2c8-4e6a-8ef4-c137528fd289"}} {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:40:08.503325 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-914ed270-50f6-4279-a48d-b44d3da3b3eb tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] [instance: af1af1be-6244-4c4f-ac6a-918ace6e2f1d] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:40:08.503325 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-914ed270-50f6-4279-a48d-b44d3da3b3eb tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:08.503325 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-914ed270-50f6-4279-a48d-b44d3da3b3eb tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:08.504220 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-d89ce862-6217-4490-b034-f64d57a01aa4 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:40:08.504795 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-914ed270-50f6-4279-a48d-b44d3da3b3eb tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:08.504795 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-914ed270-50f6-4279-a48d-b44d3da3b3eb tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:08.504963 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-d89ce862-6217-4490-b034-f64d57a01aa4 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 314a1177-9252-4a27-8c30-0b7af796d9a5] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:40:08.516066 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-d89ce862-6217-4490-b034-f64d57a01aa4 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:08.517294 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-d89ce862-6217-4490-b034-f64d57a01aa4 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:08.520609 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-d89ce862-6217-4490-b034-f64d57a01aa4 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:08.521722 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-d89ce862-6217-4490-b034-f64d57a01aa4 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:08.687666 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-d89ce862-6217-4490-b034-f64d57a01aa4 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eb9ec1f3ff44bbb03cf934cb2a04de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eae64ee53144e4f8d583bb4288c0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:40:08.696147 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-d89ce862-6217-4490-b034-f64d57a01aa4 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/314a1177-9252-4a27-8c30-0b7af796d9a5" status: 200 len: 1367 microversion: 2.1 time: 0.202225 Jun 07 14:40:08.696754 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 79/153] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:40:08 2022] GET /compute/v2.1/servers/314a1177-9252-4a27-8c30-0b7af796d9a5 => generated 1367 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:40:08.710657 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-623247b9-d1b4-482a-a552-d390db28c335 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:40:08.713934 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-623247b9-d1b4-482a-a552-d390db28c335 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:40:08.718384 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-623247b9-d1b4-482a-a552-d390db28c335 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:08.719000 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-623247b9-d1b4-482a-a552-d390db28c335 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:08.719917 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-623247b9-d1b4-482a-a552-d390db28c335 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:08.720350 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-623247b9-d1b4-482a-a552-d390db28c335 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:08.863740 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-623247b9-d1b4-482a-a552-d390db28c335 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb4b0cf5f8b4274b787f327793964f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ba26b86c7243dab8e6c6b84ed674e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:40:08.867425 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG dbcounter [-] [118158] Writing DB stats nova_cell1:SELECT=100 {{(pid=118158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:40:08.871798 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-623247b9-d1b4-482a-a552-d390db28c335 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6" status: 200 len: 1363 microversion: 2.1 time: 0.165114 Jun 07 14:40:08.872348 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 80/154] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:40:08 2022] GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:40:08.981819 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-81e8f339-fe73-4ed0-a160-8f3954faaabe tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:40:08.982544 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-81e8f339-fe73-4ed0-a160-8f3954faaabe tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: ee2e782c-42ff-4093-9246-75d4e69929b3] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:40:08.988566 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-81e8f339-fe73-4ed0-a160-8f3954faaabe tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:08.989200 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-81e8f339-fe73-4ed0-a160-8f3954faaabe tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:08.990181 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-81e8f339-fe73-4ed0-a160-8f3954faaabe tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:08.990614 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-81e8f339-fe73-4ed0-a160-8f3954faaabe tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:09.155935 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-81e8f339-fe73-4ed0-a160-8f3954faaabe tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:40:09.177555 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-81e8f339-fe73-4ed0-a160-8f3954faaabe tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3" status: 200 len: 1319 microversion: 2.1 time: 0.199466 Jun 07 14:40:09.179962 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 81/155] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:40:08 2022] GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3 => generated 1319 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:40:09.713624 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-ef3ad13a-ed91-4571-ae8f-ef0e3abb5c7f tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:40:09.719491 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-ef3ad13a-ed91-4571-ae8f-ef0e3abb5c7f tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 314a1177-9252-4a27-8c30-0b7af796d9a5] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:40:09.730761 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-ef3ad13a-ed91-4571-ae8f-ef0e3abb5c7f tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:09.731390 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-ef3ad13a-ed91-4571-ae8f-ef0e3abb5c7f tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:09.735584 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-ef3ad13a-ed91-4571-ae8f-ef0e3abb5c7f tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:09.736818 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-ef3ad13a-ed91-4571-ae8f-ef0e3abb5c7f tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:09.998827 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-ef3ad13a-ed91-4571-ae8f-ef0e3abb5c7f tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eb9ec1f3ff44bbb03cf934cb2a04de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eae64ee53144e4f8d583bb4288c0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:40:10.006741 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-ef3ad13a-ed91-4571-ae8f-ef0e3abb5c7f tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/314a1177-9252-4a27-8c30-0b7af796d9a5" status: 200 len: 1367 microversion: 2.1 time: 0.297196 Jun 07 14:40:10.007306 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 82/156] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:40:09 2022] GET /compute/v2.1/servers/314a1177-9252-4a27-8c30-0b7af796d9a5 => generated 1367 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:40:10.011978 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-e35eab4f-76d9-4860-9134-c4ab9ef14bc7 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:40:10.013060 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-e35eab4f-76d9-4860-9134-c4ab9ef14bc7 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:40:10.019561 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-e35eab4f-76d9-4860-9134-c4ab9ef14bc7 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:10.020017 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-e35eab4f-76d9-4860-9134-c4ab9ef14bc7 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:10.021193 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-e35eab4f-76d9-4860-9134-c4ab9ef14bc7 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:10.021960 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-e35eab4f-76d9-4860-9134-c4ab9ef14bc7 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:10.164257 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-e35eab4f-76d9-4860-9134-c4ab9ef14bc7 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb4b0cf5f8b4274b787f327793964f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ba26b86c7243dab8e6c6b84ed674e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:40:10.172614 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-e35eab4f-76d9-4860-9134-c4ab9ef14bc7 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6" status: 200 len: 1363 microversion: 2.1 time: 0.164080 Jun 07 14:40:10.176217 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 83/157] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:40:10 2022] GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:40:10.197649 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-2ea72896-281f-4477-a6de-103d02a629db tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:40:10.198391 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-2ea72896-281f-4477-a6de-103d02a629db tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: ee2e782c-42ff-4093-9246-75d4e69929b3] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:40:10.205040 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-2ea72896-281f-4477-a6de-103d02a629db tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:10.205792 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-2ea72896-281f-4477-a6de-103d02a629db tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:10.212889 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-2ea72896-281f-4477-a6de-103d02a629db tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:10.212889 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-2ea72896-281f-4477-a6de-103d02a629db tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:10.343354 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-2ea72896-281f-4477-a6de-103d02a629db tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:40:10.350805 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-2ea72896-281f-4477-a6de-103d02a629db tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3" status: 200 len: 1319 microversion: 2.1 time: 0.157396 Jun 07 14:40:10.351357 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 84/158] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:40:10 2022] GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:40:11.009409 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [req-a855f3e9-f96c-4d9a-82a2-b92c44ad1b46 req-f0d09fa4-55fa-40e1-8697-4bef5c128564 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6", "name": "network-vif-plugged", "status": "completed", "tag": "0846b81f-bd2c-4547-87e2-dc3a37931c85"}]} {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:40:11.029493 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [req-a855f3e9-f96c-4d9a-82a2-b92c44ad1b46 req-f0d09fa4-55fa-40e1-8697-4bef5c128564 service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:11.030050 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [req-a855f3e9-f96c-4d9a-82a2-b92c44ad1b46 req-f0d09fa4-55fa-40e1-8697-4bef5c128564 service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:11.064050 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.compute.server_external_events [req-a855f3e9-f96c-4d9a-82a2-b92c44ad1b46 req-f0d09fa4-55fa-40e1-8697-4bef5c128564 service nova] Creating event network-vif-plugged:0846b81f-bd2c-4547-87e2-dc3a37931c85 for instance e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 on hv-cinder-84497 Jun 07 14:40:11.075345 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [req-a855f3e9-f96c-4d9a-82a2-b92c44ad1b46 req-f0d09fa4-55fa-40e1-8697-4bef5c128564 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069609 Jun 07 14:40:11.083247 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 85/159] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jun 7 14:40:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:40:11.093806 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-7be7302b-534b-4eca-aa74-b5a34a4fa601 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:40:11.095893 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-7be7302b-534b-4eca-aa74-b5a34a4fa601 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 314a1177-9252-4a27-8c30-0b7af796d9a5] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:40:11.108961 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-7be7302b-534b-4eca-aa74-b5a34a4fa601 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:11.109957 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-7be7302b-534b-4eca-aa74-b5a34a4fa601 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:11.111921 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-7be7302b-534b-4eca-aa74-b5a34a4fa601 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:11.112863 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-7be7302b-534b-4eca-aa74-b5a34a4fa601 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:11.277793 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-7be7302b-534b-4eca-aa74-b5a34a4fa601 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eb9ec1f3ff44bbb03cf934cb2a04de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eae64ee53144e4f8d583bb4288c0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:40:11.285574 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-7be7302b-534b-4eca-aa74-b5a34a4fa601 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/314a1177-9252-4a27-8c30-0b7af796d9a5" status: 200 len: 1367 microversion: 2.1 time: 0.200303 Jun 07 14:40:11.286153 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 86/160] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:40:11 2022] GET /compute/v2.1/servers/314a1177-9252-4a27-8c30-0b7af796d9a5 => generated 1367 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:40:11.292325 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-ad0b8ff2-25c6-47b8-bf82-5dfaf6be145a tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:40:11.292325 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-ad0b8ff2-25c6-47b8-bf82-5dfaf6be145a tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:40:11.297825 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-ad0b8ff2-25c6-47b8-bf82-5dfaf6be145a tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:11.298437 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-ad0b8ff2-25c6-47b8-bf82-5dfaf6be145a tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:11.305823 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-ad0b8ff2-25c6-47b8-bf82-5dfaf6be145a tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:11.306576 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-ad0b8ff2-25c6-47b8-bf82-5dfaf6be145a tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:11.884958 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-ad0b8ff2-25c6-47b8-bf82-5dfaf6be145a tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb4b0cf5f8b4274b787f327793964f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ba26b86c7243dab8e6c6b84ed674e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:40:11.895816 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-ad0b8ff2-25c6-47b8-bf82-5dfaf6be145a tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6" status: 200 len: 1363 microversion: 2.1 time: 0.607226 Jun 07 14:40:11.896657 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 87/161] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:40:11 2022] GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 => generated 1363 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:40:11.903347 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-7ec4e193-1333-4fe8-a5f7-c55a73fe0c77 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:40:11.904618 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-7ec4e193-1333-4fe8-a5f7-c55a73fe0c77 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: ee2e782c-42ff-4093-9246-75d4e69929b3] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:40:11.912026 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-7ec4e193-1333-4fe8-a5f7-c55a73fe0c77 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:11.912026 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-7ec4e193-1333-4fe8-a5f7-c55a73fe0c77 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:11.913379 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-7ec4e193-1333-4fe8-a5f7-c55a73fe0c77 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:11.914165 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-7ec4e193-1333-4fe8-a5f7-c55a73fe0c77 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:12.117721 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-7ec4e193-1333-4fe8-a5f7-c55a73fe0c77 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:40:12.126535 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-7ec4e193-1333-4fe8-a5f7-c55a73fe0c77 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3" status: 200 len: 1319 microversion: 2.1 time: 0.226938 Jun 07 14:40:12.127108 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 88/162] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:40:11 2022] GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3 => generated 1319 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:40:12.191631 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-914ed270-50f6-4279-a48d-b44d3da3b3eb tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] 10.222.0.85 "POST /compute/v2.1/servers/af1af1be-6244-4c4f-ac6a-918ace6e2f1d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.705300 Jun 07 14:40:12.192316 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 75/163] 10.222.0.85 () {60 vars in 1322 bytes} [Tue Jun 7 14:40:08 2022] POST /compute/v2.1/servers/af1af1be-6244-4c4f-ac6a-918ace6e2f1d/os-volume_attachments => generated 194 bytes in 3707 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:40:12.305302 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-1b60b7e2-fe9d-437b-8aea-ff14b1ab01ba tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:40:12.306193 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-1b60b7e2-fe9d-437b-8aea-ff14b1ab01ba tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 314a1177-9252-4a27-8c30-0b7af796d9a5] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:40:12.313489 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-1b60b7e2-fe9d-437b-8aea-ff14b1ab01ba tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:12.314132 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-1b60b7e2-fe9d-437b-8aea-ff14b1ab01ba tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:12.315332 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-1b60b7e2-fe9d-437b-8aea-ff14b1ab01ba tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:12.316917 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-1b60b7e2-fe9d-437b-8aea-ff14b1ab01ba tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:12.470547 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-1b60b7e2-fe9d-437b-8aea-ff14b1ab01ba tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eb9ec1f3ff44bbb03cf934cb2a04de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eae64ee53144e4f8d583bb4288c0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:40:12.479307 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-1b60b7e2-fe9d-437b-8aea-ff14b1ab01ba tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/314a1177-9252-4a27-8c30-0b7af796d9a5" status: 200 len: 1367 microversion: 2.1 time: 0.179879 Jun 07 14:40:12.489312 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 89/164] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:40:12 2022] GET /compute/v2.1/servers/314a1177-9252-4a27-8c30-0b7af796d9a5 => generated 1367 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:40:12.914708 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-6a58e449-4578-4b02-9843-60fe11022b85 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:40:12.915422 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-6a58e449-4578-4b02-9843-60fe11022b85 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:40:12.922557 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-6a58e449-4578-4b02-9843-60fe11022b85 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:12.923280 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-6a58e449-4578-4b02-9843-60fe11022b85 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:12.924207 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-6a58e449-4578-4b02-9843-60fe11022b85 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:12.924921 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-6a58e449-4578-4b02-9843-60fe11022b85 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:13.087240 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-6a58e449-4578-4b02-9843-60fe11022b85 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb4b0cf5f8b4274b787f327793964f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ba26b86c7243dab8e6c6b84ed674e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:40:13.109833 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-6a58e449-4578-4b02-9843-60fe11022b85 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6" status: 200 len: 1363 microversion: 2.1 time: 0.196977 Jun 07 14:40:13.112670 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 76/165] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:40:12 2022] GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 => generated 1363 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:40:13.145279 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-26952036-a278-4022-86db-8803c686e06e tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:40:13.146515 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-26952036-a278-4022-86db-8803c686e06e tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: ee2e782c-42ff-4093-9246-75d4e69929b3] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:40:13.153523 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-26952036-a278-4022-86db-8803c686e06e tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:13.154196 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-26952036-a278-4022-86db-8803c686e06e tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:13.155178 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-26952036-a278-4022-86db-8803c686e06e tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:13.155912 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-26952036-a278-4022-86db-8803c686e06e tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:13.396189 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-26952036-a278-4022-86db-8803c686e06e tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:40:13.409174 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-26952036-a278-4022-86db-8803c686e06e tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3" status: 200 len: 1319 microversion: 2.1 time: 0.268044 Jun 07 14:40:13.410024 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 90/166] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:40:13 2022] GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3 => generated 1319 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:40:13.497359 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-b9a6362a-a5e3-455f-aa2b-42e52159ea6b tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:40:13.498103 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-b9a6362a-a5e3-455f-aa2b-42e52159ea6b tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 314a1177-9252-4a27-8c30-0b7af796d9a5] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:40:13.506933 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-b9a6362a-a5e3-455f-aa2b-42e52159ea6b tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:13.508283 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-b9a6362a-a5e3-455f-aa2b-42e52159ea6b tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:13.509203 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-b9a6362a-a5e3-455f-aa2b-42e52159ea6b tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:13.510023 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-b9a6362a-a5e3-455f-aa2b-42e52159ea6b tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:13.669650 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-b9a6362a-a5e3-455f-aa2b-42e52159ea6b tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eb9ec1f3ff44bbb03cf934cb2a04de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eae64ee53144e4f8d583bb4288c0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:40:13.680126 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-b9a6362a-a5e3-455f-aa2b-42e52159ea6b tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/314a1177-9252-4a27-8c30-0b7af796d9a5" status: 200 len: 1367 microversion: 2.1 time: 0.186457 Jun 07 14:40:13.680778 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 77/167] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:40:13 2022] GET /compute/v2.1/servers/314a1177-9252-4a27-8c30-0b7af796d9a5 => generated 1367 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:40:14.135920 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-5eebc642-b581-4086-82aa-6546dab2ad93 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:40:14.136919 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-5eebc642-b581-4086-82aa-6546dab2ad93 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:40:14.147282 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5eebc642-b581-4086-82aa-6546dab2ad93 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:14.148143 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5eebc642-b581-4086-82aa-6546dab2ad93 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:14.149359 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5eebc642-b581-4086-82aa-6546dab2ad93 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:14.149820 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5eebc642-b581-4086-82aa-6546dab2ad93 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:14.314195 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-5eebc642-b581-4086-82aa-6546dab2ad93 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb4b0cf5f8b4274b787f327793964f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ba26b86c7243dab8e6c6b84ed674e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:40:14.322077 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-5eebc642-b581-4086-82aa-6546dab2ad93 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6" status: 200 len: 1363 microversion: 2.1 time: 0.191816 Jun 07 14:40:14.324682 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 91/168] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:40:14 2022] GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 => generated 1363 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:40:14.426755 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-6f9bef53-9149-4eaa-9195-6939893c29ac tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:40:14.427377 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-6f9bef53-9149-4eaa-9195-6939893c29ac tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: ee2e782c-42ff-4093-9246-75d4e69929b3] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:40:14.434285 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-6f9bef53-9149-4eaa-9195-6939893c29ac tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:14.434736 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-6f9bef53-9149-4eaa-9195-6939893c29ac tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:14.435678 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-6f9bef53-9149-4eaa-9195-6939893c29ac tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:14.436795 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-6f9bef53-9149-4eaa-9195-6939893c29ac tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:14.585495 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-6f9bef53-9149-4eaa-9195-6939893c29ac tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:40:14.593252 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-6f9bef53-9149-4eaa-9195-6939893c29ac tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3" status: 200 len: 1319 microversion: 2.1 time: 0.170540 Jun 07 14:40:14.594139 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 78/169] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:40:14 2022] GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3 => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:40:14.697711 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-3c07db86-744b-4655-b8f9-7fda53740427 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:40:14.698336 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-3c07db86-744b-4655-b8f9-7fda53740427 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 314a1177-9252-4a27-8c30-0b7af796d9a5] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:40:14.705476 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-3c07db86-744b-4655-b8f9-7fda53740427 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:14.706283 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-3c07db86-744b-4655-b8f9-7fda53740427 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:14.707129 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-3c07db86-744b-4655-b8f9-7fda53740427 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:14.707788 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-3c07db86-744b-4655-b8f9-7fda53740427 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:14.953928 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [req-2860696e-9861-48a1-b65d-6a710f8212fb req-3ead5cf1-39fd-41c4-896f-0bc8024f802e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee2e782c-42ff-4093-9246-75d4e69929b3", "name": "network-vif-plugged", "status": "completed", "tag": "459067e8-6ae6-4176-ac6a-fa525305f17b"}]} {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:40:14.956502 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-3c07db86-744b-4655-b8f9-7fda53740427 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eb9ec1f3ff44bbb03cf934cb2a04de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eae64ee53144e4f8d583bb4288c0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:40:14.964897 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-3c07db86-744b-4655-b8f9-7fda53740427 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/314a1177-9252-4a27-8c30-0b7af796d9a5" status: 200 len: 1557 microversion: 2.1 time: 0.270965 Jun 07 14:40:14.969437 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 92/170] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:40:14 2022] GET /compute/v2.1/servers/314a1177-9252-4a27-8c30-0b7af796d9a5 => generated 1557 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:40:14.987152 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [req-2860696e-9861-48a1-b65d-6a710f8212fb req-3ead5cf1-39fd-41c4-896f-0bc8024f802e service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:14.987152 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [req-2860696e-9861-48a1-b65d-6a710f8212fb req-3ead5cf1-39fd-41c4-896f-0bc8024f802e service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:14.993677 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-64aaac99-b017-4dfc-824a-f26c516ea49c tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:40:14.994186 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-64aaac99-b017-4dfc-824a-f26c516ea49c tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 314a1177-9252-4a27-8c30-0b7af796d9a5] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:40:15.011990 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-64aaac99-b017-4dfc-824a-f26c516ea49c tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:15.012842 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-64aaac99-b017-4dfc-824a-f26c516ea49c tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:15.013667 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-64aaac99-b017-4dfc-824a-f26c516ea49c tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:15.018513 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-64aaac99-b017-4dfc-824a-f26c516ea49c tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:15.045979 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.compute.server_external_events [req-2860696e-9861-48a1-b65d-6a710f8212fb req-3ead5cf1-39fd-41c4-896f-0bc8024f802e service nova] Creating event network-vif-plugged:459067e8-6ae6-4176-ac6a-fa525305f17b for instance ee2e782c-42ff-4093-9246-75d4e69929b3 on hv-cinder-84497 Jun 07 14:40:15.052962 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [req-2860696e-9861-48a1-b65d-6a710f8212fb req-3ead5cf1-39fd-41c4-896f-0bc8024f802e service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102419 Jun 07 14:40:15.053720 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 79/171] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jun 7 14:40:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 14:40:15.188222 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-64aaac99-b017-4dfc-824a-f26c516ea49c tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/314a1177-9252-4a27-8c30-0b7af796d9a5/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.199667 Jun 07 14:40:15.188851 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 93/172] 10.222.0.85 () {58 vars in 1274 bytes} [Tue Jun 7 14:40:14 2022] GET /compute/v2.1/servers/314a1177-9252-4a27-8c30-0b7af796d9a5/os-interface => generated 285 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 14:40:15.339941 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-d5d96dae-3322-48e2-9b47-95be4ffca38b tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:40:15.340747 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-d5d96dae-3322-48e2-9b47-95be4ffca38b tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:40:15.348842 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-d5d96dae-3322-48e2-9b47-95be4ffca38b tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:15.350053 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-d5d96dae-3322-48e2-9b47-95be4ffca38b tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:15.352354 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-d5d96dae-3322-48e2-9b47-95be4ffca38b tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:15.352354 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-d5d96dae-3322-48e2-9b47-95be4ffca38b tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:15.610842 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-aa285aca-03af-4110-96d6-36358634a7e8 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:40:15.612732 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-aa285aca-03af-4110-96d6-36358634a7e8 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: ee2e782c-42ff-4093-9246-75d4e69929b3] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:40:15.631743 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-aa285aca-03af-4110-96d6-36358634a7e8 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:15.632494 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-aa285aca-03af-4110-96d6-36358634a7e8 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:15.633449 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-aa285aca-03af-4110-96d6-36358634a7e8 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:15.636824 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-aa285aca-03af-4110-96d6-36358634a7e8 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:15.843891 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-d5d96dae-3322-48e2-9b47-95be4ffca38b tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb4b0cf5f8b4274b787f327793964f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ba26b86c7243dab8e6c6b84ed674e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:40:15.865426 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-d5d96dae-3322-48e2-9b47-95be4ffca38b tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6" status: 200 len: 1550 microversion: 2.1 time: 0.529701 Jun 07 14:40:15.884337 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 80/173] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:40:15 2022] GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 => generated 1550 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:40:15.893942 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-b2c02d74-9e6a-4e59-ab41-f678c4aa308c tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:40:15.895035 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-b2c02d74-9e6a-4e59-ab41-f678c4aa308c tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:40:15.947006 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-b2c02d74-9e6a-4e59-ab41-f678c4aa308c tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:15.948197 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-b2c02d74-9e6a-4e59-ab41-f678c4aa308c tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:15.949165 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-b2c02d74-9e6a-4e59-ab41-f678c4aa308c tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:15.949748 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-b2c02d74-9e6a-4e59-ab41-f678c4aa308c tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:16.062305 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-aa285aca-03af-4110-96d6-36358634a7e8 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:40:16.079128 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-aa285aca-03af-4110-96d6-36358634a7e8 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3" status: 200 len: 1319 microversion: 2.1 time: 0.471193 Jun 07 14:40:16.086779 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 94/174] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:40:15 2022] GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3 => generated 1319 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:40:16.164688 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-b2c02d74-9e6a-4e59-ab41-f678c4aa308c tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.275664 Jun 07 14:40:16.164688 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 81/175] 10.222.0.85 () {58 vars in 1274 bytes} [Tue Jun 7 14:40:15 2022] GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6/os-interface => generated 285 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:40:17.109168 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-ba7b262d-7681-4f5c-bc28-613f8c4277a0 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:40:17.109168 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-ba7b262d-7681-4f5c-bc28-613f8c4277a0 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: ee2e782c-42ff-4093-9246-75d4e69929b3] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:40:17.116158 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-ba7b262d-7681-4f5c-bc28-613f8c4277a0 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:17.131342 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-ba7b262d-7681-4f5c-bc28-613f8c4277a0 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:17.131342 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-ba7b262d-7681-4f5c-bc28-613f8c4277a0 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:17.131342 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-ba7b262d-7681-4f5c-bc28-613f8c4277a0 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:17.387947 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-ba7b262d-7681-4f5c-bc28-613f8c4277a0 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:40:17.409056 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-ba7b262d-7681-4f5c-bc28-613f8c4277a0 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3" status: 200 len: 1319 microversion: 2.1 time: 0.313678 Jun 07 14:40:17.413213 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 95/176] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:40:17 2022] GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3 => generated 1319 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:40:17.456270 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [req-15ab4ad4-0d6b-43e4-abdc-b5bd08b622b3 req-47cccca5-b614-43ba-b59c-85435b96d0b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "314a1177-9252-4a27-8c30-0b7af796d9a5", "tag": "8997ff45-6df9-4130-98b4-85dfcdb44008"}]} {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:40:17.467925 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [req-15ab4ad4-0d6b-43e4-abdc-b5bd08b622b3 req-47cccca5-b614-43ba-b59c-85435b96d0b3 service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:17.468975 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [req-15ab4ad4-0d6b-43e4-abdc-b5bd08b622b3 req-47cccca5-b614-43ba-b59c-85435b96d0b3 service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:17.483021 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.compute.server_external_events [req-15ab4ad4-0d6b-43e4-abdc-b5bd08b622b3 req-47cccca5-b614-43ba-b59c-85435b96d0b3 service nova] Creating event network-changed:8997ff45-6df9-4130-98b4-85dfcdb44008 for instance 314a1177-9252-4a27-8c30-0b7af796d9a5 on hv-cinder-84497 Jun 07 14:40:17.488666 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [req-15ab4ad4-0d6b-43e4-abdc-b5bd08b622b3 req-47cccca5-b614-43ba-b59c-85435b96d0b3 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038679 Jun 07 14:40:17.493887 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 82/177] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jun 7 14:40:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:40:18.264620 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [req-b8a3e7fd-d1f5-4e0d-8955-0124897e3a92 req-75e8a39b-c45c-4653-a44c-892ad27412f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6", "tag": "0846b81f-bd2c-4547-87e2-dc3a37931c85"}]} {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:40:18.275179 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [req-b8a3e7fd-d1f5-4e0d-8955-0124897e3a92 req-75e8a39b-c45c-4653-a44c-892ad27412f9 service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:18.276031 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [req-b8a3e7fd-d1f5-4e0d-8955-0124897e3a92 req-75e8a39b-c45c-4653-a44c-892ad27412f9 service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:18.290594 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.compute.server_external_events [req-b8a3e7fd-d1f5-4e0d-8955-0124897e3a92 req-75e8a39b-c45c-4653-a44c-892ad27412f9 service nova] Creating event network-changed:0846b81f-bd2c-4547-87e2-dc3a37931c85 for instance e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 on hv-cinder-84497 Jun 07 14:40:18.299944 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [req-b8a3e7fd-d1f5-4e0d-8955-0124897e3a92 req-75e8a39b-c45c-4653-a44c-892ad27412f9 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041687 Jun 07 14:40:18.301565 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 96/178] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jun 7 14:40:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:40:18.432250 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-2c0d283d-7ca8-4acc-a07b-d67778b259a3 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:40:18.433338 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-2c0d283d-7ca8-4acc-a07b-d67778b259a3 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: ee2e782c-42ff-4093-9246-75d4e69929b3] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:40:18.444669 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-2c0d283d-7ca8-4acc-a07b-d67778b259a3 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:18.446909 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-2c0d283d-7ca8-4acc-a07b-d67778b259a3 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:18.454634 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-2c0d283d-7ca8-4acc-a07b-d67778b259a3 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:18.457900 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-2c0d283d-7ca8-4acc-a07b-d67778b259a3 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:18.664038 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-2c0d283d-7ca8-4acc-a07b-d67778b259a3 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:40:18.685855 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-2c0d283d-7ca8-4acc-a07b-d67778b259a3 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3" status: 200 len: 1513 microversion: 2.1 time: 0.258978 Jun 07 14:40:18.686555 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 83/179] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:40:18 2022] GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3 => generated 1513 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:40:18.724201 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-fd108b7f-d2f9-4de9-8a64-be2882faec5a tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:40:18.725557 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-fd108b7f-d2f9-4de9-8a64-be2882faec5a tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: ee2e782c-42ff-4093-9246-75d4e69929b3] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:40:18.735001 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-fd108b7f-d2f9-4de9-8a64-be2882faec5a tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:18.735665 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-fd108b7f-d2f9-4de9-8a64-be2882faec5a tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:18.736824 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-fd108b7f-d2f9-4de9-8a64-be2882faec5a tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:18.737473 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-fd108b7f-d2f9-4de9-8a64-be2882faec5a tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:18.803490 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.objects.instance [None req-fd108b7f-d2f9-4de9-8a64-be2882faec5a tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lazy-loading 'flavor' on Instance uuid ee2e782c-42ff-4093-9246-75d4e69929b3 {{(pid=118158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 14:40:19.079198 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG dbcounter [-] [118158] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=118158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:40:19.278614 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-fd108b7f-d2f9-4de9-8a64-be2882faec5a tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "POST /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3/action" status: 200 len: 32 microversion: 2.1 time: 0.557008 Jun 07 14:40:19.278614 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 97/180] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Jun 7 14:40:18 2022] POST /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3/action => generated 32 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 07 14:40:19.285817 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-4c3a440d-6426-4106-bd6e-5b18eb00e516 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:40:19.286707 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-4c3a440d-6426-4106-bd6e-5b18eb00e516 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: ee2e782c-42ff-4093-9246-75d4e69929b3] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:40:19.298243 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-4c3a440d-6426-4106-bd6e-5b18eb00e516 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:19.301295 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-4c3a440d-6426-4106-bd6e-5b18eb00e516 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:19.301295 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-4c3a440d-6426-4106-bd6e-5b18eb00e516 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:19.301295 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-4c3a440d-6426-4106-bd6e-5b18eb00e516 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:19.455388 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-4c3a440d-6426-4106-bd6e-5b18eb00e516 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:40:19.472748 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-4c3a440d-6426-4106-bd6e-5b18eb00e516 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3" status: 200 len: 1519 microversion: 2.1 time: 0.190920 Jun 07 14:40:19.473399 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 84/181] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:40:19 2022] GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3 => generated 1519 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:40:20.490793 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-36a05411-8939-4481-90d7-c958aa51c685 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:40:20.491397 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-36a05411-8939-4481-90d7-c958aa51c685 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: ee2e782c-42ff-4093-9246-75d4e69929b3] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:40:20.498183 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-36a05411-8939-4481-90d7-c958aa51c685 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:20.499147 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-36a05411-8939-4481-90d7-c958aa51c685 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:20.499997 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-36a05411-8939-4481-90d7-c958aa51c685 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:20.500443 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-36a05411-8939-4481-90d7-c958aa51c685 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:20.641202 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-36a05411-8939-4481-90d7-c958aa51c685 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:40:20.651119 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-36a05411-8939-4481-90d7-c958aa51c685 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3" status: 200 len: 1519 microversion: 2.1 time: 0.165060 Jun 07 14:40:20.652147 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 98/182] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:40:20 2022] GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3 => generated 1519 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:40:21.669221 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-2351dab6-4728-4b4e-9c5a-0059ae60c722 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:40:21.670905 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-2351dab6-4728-4b4e-9c5a-0059ae60c722 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: ee2e782c-42ff-4093-9246-75d4e69929b3] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:40:21.680592 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-2351dab6-4728-4b4e-9c5a-0059ae60c722 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:21.681555 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-2351dab6-4728-4b4e-9c5a-0059ae60c722 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:21.682887 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-2351dab6-4728-4b4e-9c5a-0059ae60c722 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:21.683570 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-2351dab6-4728-4b4e-9c5a-0059ae60c722 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:21.886260 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-2351dab6-4728-4b4e-9c5a-0059ae60c722 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:40:21.895306 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-2351dab6-4728-4b4e-9c5a-0059ae60c722 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3" status: 200 len: 1519 microversion: 2.1 time: 0.230446 Jun 07 14:40:21.895964 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 85/183] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:40:21 2022] GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3 => generated 1519 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:40:22.917394 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-bef2dd57-43cc-49d1-b03f-ca6843503e66 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:40:22.918022 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-bef2dd57-43cc-49d1-b03f-ca6843503e66 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: ee2e782c-42ff-4093-9246-75d4e69929b3] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:40:22.924989 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-bef2dd57-43cc-49d1-b03f-ca6843503e66 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:22.925438 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-bef2dd57-43cc-49d1-b03f-ca6843503e66 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:22.927747 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-bef2dd57-43cc-49d1-b03f-ca6843503e66 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:22.928467 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-bef2dd57-43cc-49d1-b03f-ca6843503e66 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:23.088058 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-bef2dd57-43cc-49d1-b03f-ca6843503e66 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:40:23.095945 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-bef2dd57-43cc-49d1-b03f-ca6843503e66 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3" status: 200 len: 1519 microversion: 2.1 time: 0.183357 Jun 07 14:40:23.096550 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 99/184] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:40:22 2022] GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3 => generated 1519 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:40:24.113767 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-251fead7-9636-4ea8-9804-3b3d5d293cff tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:40:24.114379 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-251fead7-9636-4ea8-9804-3b3d5d293cff tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: ee2e782c-42ff-4093-9246-75d4e69929b3] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:40:24.121079 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-251fead7-9636-4ea8-9804-3b3d5d293cff tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:24.121521 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-251fead7-9636-4ea8-9804-3b3d5d293cff tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:24.123195 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-251fead7-9636-4ea8-9804-3b3d5d293cff tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:24.124459 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-251fead7-9636-4ea8-9804-3b3d5d293cff tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:24.129275 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG dbcounter [-] [118157] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:40:24.282996 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-251fead7-9636-4ea8-9804-3b3d5d293cff tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:40:24.290633 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-251fead7-9636-4ea8-9804-3b3d5d293cff tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3" status: 200 len: 1519 microversion: 2.1 time: 0.180708 Jun 07 14:40:24.291207 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 86/185] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:40:24 2022] GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3 => generated 1519 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:40:25.308518 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-dcf0c28b-ba78-4e3a-88c9-e2e2472966fc tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:40:25.309282 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-dcf0c28b-ba78-4e3a-88c9-e2e2472966fc tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: ee2e782c-42ff-4093-9246-75d4e69929b3] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:40:25.311619 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG dbcounter [-] [118158] Writing DB stats nova_api:SELECT=97 {{(pid=118158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:40:25.316423 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-dcf0c28b-ba78-4e3a-88c9-e2e2472966fc tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:25.317110 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-dcf0c28b-ba78-4e3a-88c9-e2e2472966fc tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:25.317960 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-dcf0c28b-ba78-4e3a-88c9-e2e2472966fc tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:25.318336 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-dcf0c28b-ba78-4e3a-88c9-e2e2472966fc tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:25.458307 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-dcf0c28b-ba78-4e3a-88c9-e2e2472966fc tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:40:25.466134 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-dcf0c28b-ba78-4e3a-88c9-e2e2472966fc tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3" status: 200 len: 1519 microversion: 2.1 time: 0.161645 Jun 07 14:40:25.466692 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 100/186] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:40:25 2022] GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3 => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:40:26.483438 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-6f102079-db23-4072-9442-a2f3f4d2e0b2 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:40:26.484048 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-6f102079-db23-4072-9442-a2f3f4d2e0b2 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: ee2e782c-42ff-4093-9246-75d4e69929b3] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:40:26.494557 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-6f102079-db23-4072-9442-a2f3f4d2e0b2 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:26.494557 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-6f102079-db23-4072-9442-a2f3f4d2e0b2 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:26.494557 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-6f102079-db23-4072-9442-a2f3f4d2e0b2 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:26.494557 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-6f102079-db23-4072-9442-a2f3f4d2e0b2 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:26.620698 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-6f102079-db23-4072-9442-a2f3f4d2e0b2 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:40:26.628579 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-6f102079-db23-4072-9442-a2f3f4d2e0b2 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3" status: 200 len: 1519 microversion: 2.1 time: 0.149724 Jun 07 14:40:26.629144 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 87/187] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:40:26 2022] GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3 => generated 1519 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:40:27.644431 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-07cb6f74-a383-4f90-b8dd-f20a7f1c7b20 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:40:27.645134 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-07cb6f74-a383-4f90-b8dd-f20a7f1c7b20 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: ee2e782c-42ff-4093-9246-75d4e69929b3] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:40:27.651584 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-07cb6f74-a383-4f90-b8dd-f20a7f1c7b20 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:27.657769 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-07cb6f74-a383-4f90-b8dd-f20a7f1c7b20 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:27.657769 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-07cb6f74-a383-4f90-b8dd-f20a7f1c7b20 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:27.657769 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-07cb6f74-a383-4f90-b8dd-f20a7f1c7b20 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:27.807219 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-07cb6f74-a383-4f90-b8dd-f20a7f1c7b20 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:40:27.817114 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-07cb6f74-a383-4f90-b8dd-f20a7f1c7b20 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3" status: 200 len: 1519 microversion: 2.1 time: 0.176449 Jun 07 14:40:27.818598 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 101/188] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:40:27 2022] GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3 => generated 1519 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:40:27.881475 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-8e96117c-cf29-4228-81ce-b76e670ebbb1 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:40:27.881977 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-8e96117c-cf29-4228-81ce-b76e670ebbb1 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] [instance: af1af1be-6244-4c4f-ac6a-918ace6e2f1d] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:40:27.890648 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-8e96117c-cf29-4228-81ce-b76e670ebbb1 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:27.891194 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-8e96117c-cf29-4228-81ce-b76e670ebbb1 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:27.892237 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-8e96117c-cf29-4228-81ce-b76e670ebbb1 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:27.893391 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-8e96117c-cf29-4228-81ce-b76e670ebbb1 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:27.923228 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-8e96117c-cf29-4228-81ce-b76e670ebbb1 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] [instance: af1af1be-6244-4c4f-ac6a-918ace6e2f1d] Going to try to terminate instance {{(pid=118157) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 14:40:28.152416 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-8e96117c-cf29-4228-81ce-b76e670ebbb1 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] 10.222.0.85 "DELETE /compute/v2.1/servers/af1af1be-6244-4c4f-ac6a-918ace6e2f1d" status: 204 len: 0 microversion: 2.1 time: 0.274688 Jun 07 14:40:28.153708 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 88/189] 10.222.0.85 () {58 vars in 1238 bytes} [Tue Jun 7 14:40:27 2022] DELETE /compute/v2.1/servers/af1af1be-6244-4c4f-ac6a-918ace6e2f1d => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 14:40:28.164709 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-fcfec329-28e4-4846-a18a-67ce61f2c851 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:40:28.165450 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-fcfec329-28e4-4846-a18a-67ce61f2c851 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] [instance: af1af1be-6244-4c4f-ac6a-918ace6e2f1d] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:40:28.171652 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-fcfec329-28e4-4846-a18a-67ce61f2c851 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:28.172130 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-fcfec329-28e4-4846-a18a-67ce61f2c851 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:28.172924 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-fcfec329-28e4-4846-a18a-67ce61f2c851 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:28.173362 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-fcfec329-28e4-4846-a18a-67ce61f2c851 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:28.322356 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-fcfec329-28e4-4846-a18a-67ce61f2c851 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd800b8efe792477bac3ca063920a4a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd7cee3f5704d01ae9df6d300b30004', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:40:28.331117 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-fcfec329-28e4-4846-a18a-67ce61f2c851 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] 10.222.0.85 "GET /compute/v2.1/servers/af1af1be-6244-4c4f-ac6a-918ace6e2f1d" status: 200 len: 1553 microversion: 2.1 time: 0.170816 Jun 07 14:40:28.331693 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 102/190] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:40:28 2022] GET /compute/v2.1/servers/af1af1be-6244-4c4f-ac6a-918ace6e2f1d => generated 1553 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:40:28.835897 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-4f7866a7-4068-4390-8966-f2982a138a38 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:40:28.836586 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-4f7866a7-4068-4390-8966-f2982a138a38 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: ee2e782c-42ff-4093-9246-75d4e69929b3] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:40:28.842794 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-4f7866a7-4068-4390-8966-f2982a138a38 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:28.843240 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-4f7866a7-4068-4390-8966-f2982a138a38 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:28.844007 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-4f7866a7-4068-4390-8966-f2982a138a38 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:28.844577 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-4f7866a7-4068-4390-8966-f2982a138a38 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:28.976781 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-4f7866a7-4068-4390-8966-f2982a138a38 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:40:28.984045 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-4f7866a7-4068-4390-8966-f2982a138a38 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3" status: 200 len: 1519 microversion: 2.1 time: 0.152347 Jun 07 14:40:28.984676 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 89/191] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:40:28 2022] GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3 => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:40:29.348214 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-9de73410-16aa-4bec-85bb-c8c9b536e82a tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:40:29.348888 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-9de73410-16aa-4bec-85bb-c8c9b536e82a tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] [instance: af1af1be-6244-4c4f-ac6a-918ace6e2f1d] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:40:29.354892 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-9de73410-16aa-4bec-85bb-c8c9b536e82a tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:29.355344 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-9de73410-16aa-4bec-85bb-c8c9b536e82a tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:29.356113 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-9de73410-16aa-4bec-85bb-c8c9b536e82a tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:29.356585 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-9de73410-16aa-4bec-85bb-c8c9b536e82a tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:29.484119 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-9de73410-16aa-4bec-85bb-c8c9b536e82a tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd800b8efe792477bac3ca063920a4a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd7cee3f5704d01ae9df6d300b30004', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:40:29.492047 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-9de73410-16aa-4bec-85bb-c8c9b536e82a tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] 10.222.0.85 "GET /compute/v2.1/servers/af1af1be-6244-4c4f-ac6a-918ace6e2f1d" status: 200 len: 1553 microversion: 2.1 time: 0.147638 Jun 07 14:40:29.492650 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 103/192] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:40:29 2022] GET /compute/v2.1/servers/af1af1be-6244-4c4f-ac6a-918ace6e2f1d => generated 1553 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:40:30.001472 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-ba5f472f-1bf2-4f73-b15b-4bb035785846 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:40:30.002108 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-ba5f472f-1bf2-4f73-b15b-4bb035785846 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: ee2e782c-42ff-4093-9246-75d4e69929b3] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:40:30.008633 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-ba5f472f-1bf2-4f73-b15b-4bb035785846 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:30.009079 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-ba5f472f-1bf2-4f73-b15b-4bb035785846 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:30.009833 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-ba5f472f-1bf2-4f73-b15b-4bb035785846 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:30.010268 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-ba5f472f-1bf2-4f73-b15b-4bb035785846 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:30.144063 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-ba5f472f-1bf2-4f73-b15b-4bb035785846 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:40:30.152178 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-ba5f472f-1bf2-4f73-b15b-4bb035785846 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3" status: 200 len: 1519 microversion: 2.1 time: 0.155197 Jun 07 14:40:30.152766 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 90/193] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:40:29 2022] GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:40:30.509857 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-aa0887b1-dbb1-4e68-b732-5658f60e384c tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:40:30.510463 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-aa0887b1-dbb1-4e68-b732-5658f60e384c tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] [instance: af1af1be-6244-4c4f-ac6a-918ace6e2f1d] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:40:30.517236 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-aa0887b1-dbb1-4e68-b732-5658f60e384c tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:30.517678 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-aa0887b1-dbb1-4e68-b732-5658f60e384c tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:30.518423 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-aa0887b1-dbb1-4e68-b732-5658f60e384c tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:30.518852 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-aa0887b1-dbb1-4e68-b732-5658f60e384c tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:30.649860 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-aa0887b1-dbb1-4e68-b732-5658f60e384c tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd800b8efe792477bac3ca063920a4a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd7cee3f5704d01ae9df6d300b30004', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:40:30.658617 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-aa0887b1-dbb1-4e68-b732-5658f60e384c tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] 10.222.0.85 "GET /compute/v2.1/servers/af1af1be-6244-4c4f-ac6a-918ace6e2f1d" status: 200 len: 1553 microversion: 2.1 time: 0.152808 Jun 07 14:40:30.659187 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 104/194] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:40:30 2022] GET /compute/v2.1/servers/af1af1be-6244-4c4f-ac6a-918ace6e2f1d => generated 1553 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:40:31.169285 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-5d94f09a-aca1-4b5e-87f0-24c35f9b801c tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:40:31.169893 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-5d94f09a-aca1-4b5e-87f0-24c35f9b801c tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: ee2e782c-42ff-4093-9246-75d4e69929b3] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:40:31.176219 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-5d94f09a-aca1-4b5e-87f0-24c35f9b801c tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:31.176695 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-5d94f09a-aca1-4b5e-87f0-24c35f9b801c tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:31.177441 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-5d94f09a-aca1-4b5e-87f0-24c35f9b801c tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:31.177868 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-5d94f09a-aca1-4b5e-87f0-24c35f9b801c tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:31.304960 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-5d94f09a-aca1-4b5e-87f0-24c35f9b801c tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:40:31.312303 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-5d94f09a-aca1-4b5e-87f0-24c35f9b801c tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3" status: 200 len: 1519 microversion: 2.1 time: 0.146890 Jun 07 14:40:31.312894 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 91/195] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:40:31 2022] GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3 => generated 1519 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:40:31.678117 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-6a189f32-6cdd-4c64-b62f-07a411c6225b tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:40:31.678117 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-6a189f32-6cdd-4c64-b62f-07a411c6225b tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] [instance: af1af1be-6244-4c4f-ac6a-918ace6e2f1d] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:40:31.688815 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-6a189f32-6cdd-4c64-b62f-07a411c6225b tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:31.689603 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-6a189f32-6cdd-4c64-b62f-07a411c6225b tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:31.690957 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-6a189f32-6cdd-4c64-b62f-07a411c6225b tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:31.691706 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-6a189f32-6cdd-4c64-b62f-07a411c6225b tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:31.828005 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-6a189f32-6cdd-4c64-b62f-07a411c6225b tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd800b8efe792477bac3ca063920a4a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd7cee3f5704d01ae9df6d300b30004', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:40:31.836276 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-6a189f32-6cdd-4c64-b62f-07a411c6225b tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] 10.222.0.85 "GET /compute/v2.1/servers/af1af1be-6244-4c4f-ac6a-918ace6e2f1d" status: 200 len: 1553 microversion: 2.1 time: 0.164849 Jun 07 14:40:31.836915 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 105/196] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:40:31 2022] GET /compute/v2.1/servers/af1af1be-6244-4c4f-ac6a-918ace6e2f1d => generated 1553 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:40:32.330216 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-2b3c6fb2-f3b2-45fb-a2d0-1d2b55933ed1 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:40:32.330740 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-2b3c6fb2-f3b2-45fb-a2d0-1d2b55933ed1 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: ee2e782c-42ff-4093-9246-75d4e69929b3] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:40:32.337422 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-2b3c6fb2-f3b2-45fb-a2d0-1d2b55933ed1 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:32.337864 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-2b3c6fb2-f3b2-45fb-a2d0-1d2b55933ed1 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:32.338621 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-2b3c6fb2-f3b2-45fb-a2d0-1d2b55933ed1 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:32.339051 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-2b3c6fb2-f3b2-45fb-a2d0-1d2b55933ed1 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:32.470524 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-2b3c6fb2-f3b2-45fb-a2d0-1d2b55933ed1 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:40:32.478563 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-2b3c6fb2-f3b2-45fb-a2d0-1d2b55933ed1 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3" status: 200 len: 1519 microversion: 2.1 time: 0.152725 Jun 07 14:40:32.479122 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 92/197] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:40:32 2022] GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3 => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:40:32.853792 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-31741f98-bac1-4ec5-a28e-839d27b284b8 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:40:32.854405 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-31741f98-bac1-4ec5-a28e-839d27b284b8 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] [instance: af1af1be-6244-4c4f-ac6a-918ace6e2f1d] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:40:32.860323 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-31741f98-bac1-4ec5-a28e-839d27b284b8 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:32.861306 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-31741f98-bac1-4ec5-a28e-839d27b284b8 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:32.862053 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-31741f98-bac1-4ec5-a28e-839d27b284b8 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:32.862484 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-31741f98-bac1-4ec5-a28e-839d27b284b8 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:32.992128 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-31741f98-bac1-4ec5-a28e-839d27b284b8 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd800b8efe792477bac3ca063920a4a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd7cee3f5704d01ae9df6d300b30004', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:40:32.999935 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-31741f98-bac1-4ec5-a28e-839d27b284b8 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] 10.222.0.85 "GET /compute/v2.1/servers/af1af1be-6244-4c4f-ac6a-918ace6e2f1d" status: 200 len: 1553 microversion: 2.1 time: 0.149974 Jun 07 14:40:33.000518 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 106/198] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:40:32 2022] GET /compute/v2.1/servers/af1af1be-6244-4c4f-ac6a-918ace6e2f1d => generated 1553 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:40:33.498660 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-93136743-925d-4894-81cd-ba2834c03036 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:40:33.499347 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-93136743-925d-4894-81cd-ba2834c03036 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: ee2e782c-42ff-4093-9246-75d4e69929b3] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:40:33.506531 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-93136743-925d-4894-81cd-ba2834c03036 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:33.507038 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-93136743-925d-4894-81cd-ba2834c03036 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:33.507730 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-93136743-925d-4894-81cd-ba2834c03036 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:33.508163 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-93136743-925d-4894-81cd-ba2834c03036 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:33.645756 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-93136743-925d-4894-81cd-ba2834c03036 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:40:33.653345 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-93136743-925d-4894-81cd-ba2834c03036 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3" status: 200 len: 1519 microversion: 2.1 time: 0.158609 Jun 07 14:40:33.659440 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 93/199] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:40:33 2022] GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3 => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:40:34.018509 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-020716c5-33af-46d7-b7a1-87774ebf5f34 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:40:34.019381 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-020716c5-33af-46d7-b7a1-87774ebf5f34 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] [instance: af1af1be-6244-4c4f-ac6a-918ace6e2f1d] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:40:34.025494 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-020716c5-33af-46d7-b7a1-87774ebf5f34 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:34.025978 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-020716c5-33af-46d7-b7a1-87774ebf5f34 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:34.026738 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-020716c5-33af-46d7-b7a1-87774ebf5f34 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:34.027171 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-020716c5-33af-46d7-b7a1-87774ebf5f34 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:34.155024 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-020716c5-33af-46d7-b7a1-87774ebf5f34 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd800b8efe792477bac3ca063920a4a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd7cee3f5704d01ae9df6d300b30004', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:40:34.162962 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-020716c5-33af-46d7-b7a1-87774ebf5f34 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] 10.222.0.85 "GET /compute/v2.1/servers/af1af1be-6244-4c4f-ac6a-918ace6e2f1d" status: 200 len: 1553 microversion: 2.1 time: 0.148966 Jun 07 14:40:34.163505 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 107/200] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:40:34 2022] GET /compute/v2.1/servers/af1af1be-6244-4c4f-ac6a-918ace6e2f1d => generated 1553 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:40:34.670726 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-862e2a1b-80d0-4004-a5b3-9377dd7f2570 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:40:34.671398 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-862e2a1b-80d0-4004-a5b3-9377dd7f2570 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: ee2e782c-42ff-4093-9246-75d4e69929b3] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:40:34.678505 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-862e2a1b-80d0-4004-a5b3-9377dd7f2570 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:34.678972 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-862e2a1b-80d0-4004-a5b3-9377dd7f2570 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:34.680665 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-862e2a1b-80d0-4004-a5b3-9377dd7f2570 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:34.680665 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-862e2a1b-80d0-4004-a5b3-9377dd7f2570 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:34.822306 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-862e2a1b-80d0-4004-a5b3-9377dd7f2570 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:40:34.831226 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-862e2a1b-80d0-4004-a5b3-9377dd7f2570 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3" status: 200 len: 1519 microversion: 2.1 time: 0.164472 Jun 07 14:40:34.835874 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 94/201] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:40:34 2022] GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3 => generated 1519 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:40:35.180425 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-1dd42c3a-a470-4adc-ade4-4b2409156c32 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:40:35.181046 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-1dd42c3a-a470-4adc-ade4-4b2409156c32 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] [instance: af1af1be-6244-4c4f-ac6a-918ace6e2f1d] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:40:35.187899 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-1dd42c3a-a470-4adc-ade4-4b2409156c32 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:35.188700 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-1dd42c3a-a470-4adc-ade4-4b2409156c32 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:35.190142 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-1dd42c3a-a470-4adc-ade4-4b2409156c32 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:35.190612 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-1dd42c3a-a470-4adc-ade4-4b2409156c32 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:35.323659 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-1dd42c3a-a470-4adc-ade4-4b2409156c32 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd800b8efe792477bac3ca063920a4a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd7cee3f5704d01ae9df6d300b30004', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:40:35.331574 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-1dd42c3a-a470-4adc-ade4-4b2409156c32 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] 10.222.0.85 "GET /compute/v2.1/servers/af1af1be-6244-4c4f-ac6a-918ace6e2f1d" status: 200 len: 1553 microversion: 2.1 time: 0.155017 Jun 07 14:40:35.332120 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 108/202] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:40:35 2022] GET /compute/v2.1/servers/af1af1be-6244-4c4f-ac6a-918ace6e2f1d => generated 1553 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:40:35.847712 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-2511f007-87b5-442f-a8f6-14f74e0f830c tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:40:35.848243 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-2511f007-87b5-442f-a8f6-14f74e0f830c tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: ee2e782c-42ff-4093-9246-75d4e69929b3] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:40:35.855251 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-2511f007-87b5-442f-a8f6-14f74e0f830c tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:35.855730 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-2511f007-87b5-442f-a8f6-14f74e0f830c tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:35.856544 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-2511f007-87b5-442f-a8f6-14f74e0f830c tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:35.856983 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-2511f007-87b5-442f-a8f6-14f74e0f830c tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:36.025952 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-2511f007-87b5-442f-a8f6-14f74e0f830c tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:40:36.034823 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-2511f007-87b5-442f-a8f6-14f74e0f830c tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3" status: 200 len: 1519 microversion: 2.1 time: 0.191643 Jun 07 14:40:36.035405 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 95/203] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:40:35 2022] GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3 => generated 1519 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:40:36.347798 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-9ed4a7a5-f857-48dd-b101-69fc2225eeb4 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:40:36.348430 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-9ed4a7a5-f857-48dd-b101-69fc2225eeb4 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] [instance: af1af1be-6244-4c4f-ac6a-918ace6e2f1d] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:40:36.354537 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-9ed4a7a5-f857-48dd-b101-69fc2225eeb4 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:36.355113 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-9ed4a7a5-f857-48dd-b101-69fc2225eeb4 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:36.355762 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-9ed4a7a5-f857-48dd-b101-69fc2225eeb4 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:36.356198 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-9ed4a7a5-f857-48dd-b101-69fc2225eeb4 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:36.493947 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-9ed4a7a5-f857-48dd-b101-69fc2225eeb4 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd800b8efe792477bac3ca063920a4a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd7cee3f5704d01ae9df6d300b30004', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:40:36.502533 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-9ed4a7a5-f857-48dd-b101-69fc2225eeb4 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] 10.222.0.85 "GET /compute/v2.1/servers/af1af1be-6244-4c4f-ac6a-918ace6e2f1d" status: 200 len: 1553 microversion: 2.1 time: 0.157937 Jun 07 14:40:36.503097 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 109/204] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:40:36 2022] GET /compute/v2.1/servers/af1af1be-6244-4c4f-ac6a-918ace6e2f1d => generated 1553 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:40:37.052051 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-58a680a5-a79e-4285-aad1-a1b5505f162d tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:40:37.052701 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-58a680a5-a79e-4285-aad1-a1b5505f162d tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: ee2e782c-42ff-4093-9246-75d4e69929b3] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:40:37.059226 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-58a680a5-a79e-4285-aad1-a1b5505f162d tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:37.059679 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-58a680a5-a79e-4285-aad1-a1b5505f162d tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:37.060488 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-58a680a5-a79e-4285-aad1-a1b5505f162d tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:37.060948 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-58a680a5-a79e-4285-aad1-a1b5505f162d tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:37.197401 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-58a680a5-a79e-4285-aad1-a1b5505f162d tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:40:37.206901 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-58a680a5-a79e-4285-aad1-a1b5505f162d tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3" status: 200 len: 1519 microversion: 2.1 time: 0.159149 Jun 07 14:40:37.207475 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 96/205] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:40:37 2022] GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3 => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:40:37.519675 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-0eb08b66-2a8c-4f22-9b47-8d389fa56b9b tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:40:37.520294 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-0eb08b66-2a8c-4f22-9b47-8d389fa56b9b tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] [instance: af1af1be-6244-4c4f-ac6a-918ace6e2f1d] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:40:37.527262 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-0eb08b66-2a8c-4f22-9b47-8d389fa56b9b tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:37.527705 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-0eb08b66-2a8c-4f22-9b47-8d389fa56b9b tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:37.528495 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-0eb08b66-2a8c-4f22-9b47-8d389fa56b9b tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:37.528929 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-0eb08b66-2a8c-4f22-9b47-8d389fa56b9b tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:37.672667 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-0eb08b66-2a8c-4f22-9b47-8d389fa56b9b tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd800b8efe792477bac3ca063920a4a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd7cee3f5704d01ae9df6d300b30004', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:40:37.681785 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-0eb08b66-2a8c-4f22-9b47-8d389fa56b9b tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] 10.222.0.85 "GET /compute/v2.1/servers/af1af1be-6244-4c4f-ac6a-918ace6e2f1d" status: 200 len: 1553 microversion: 2.1 time: 0.166223 Jun 07 14:40:37.692240 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 110/206] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:40:37 2022] GET /compute/v2.1/servers/af1af1be-6244-4c4f-ac6a-918ace6e2f1d => generated 1553 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:40:38.225329 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-34ea27a8-4717-4358-9124-3f4f7e2e19b1 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:40:38.225962 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-34ea27a8-4717-4358-9124-3f4f7e2e19b1 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: ee2e782c-42ff-4093-9246-75d4e69929b3] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:40:38.232736 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-34ea27a8-4717-4358-9124-3f4f7e2e19b1 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:38.233193 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-34ea27a8-4717-4358-9124-3f4f7e2e19b1 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:38.233966 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-34ea27a8-4717-4358-9124-3f4f7e2e19b1 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:38.234405 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-34ea27a8-4717-4358-9124-3f4f7e2e19b1 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:38.380885 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-34ea27a8-4717-4358-9124-3f4f7e2e19b1 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:40:38.388506 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-34ea27a8-4717-4358-9124-3f4f7e2e19b1 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3" status: 200 len: 1519 microversion: 2.1 time: 0.167320 Jun 07 14:40:38.389239 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 97/207] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:40:38 2022] GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3 => generated 1519 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:40:38.698781 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-274e1c7f-2d7d-4d91-a88a-9b4832aa0c92 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:40:38.699398 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-274e1c7f-2d7d-4d91-a88a-9b4832aa0c92 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] [instance: af1af1be-6244-4c4f-ac6a-918ace6e2f1d] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:40:38.706192 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-274e1c7f-2d7d-4d91-a88a-9b4832aa0c92 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:38.706635 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-274e1c7f-2d7d-4d91-a88a-9b4832aa0c92 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:38.707396 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-274e1c7f-2d7d-4d91-a88a-9b4832aa0c92 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:38.707828 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-274e1c7f-2d7d-4d91-a88a-9b4832aa0c92 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:38.847333 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-274e1c7f-2d7d-4d91-a88a-9b4832aa0c92 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd800b8efe792477bac3ca063920a4a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd7cee3f5704d01ae9df6d300b30004', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:40:38.857465 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-274e1c7f-2d7d-4d91-a88a-9b4832aa0c92 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] 10.222.0.85 "GET /compute/v2.1/servers/af1af1be-6244-4c4f-ac6a-918ace6e2f1d" status: 200 len: 1553 microversion: 2.1 time: 0.162082 Jun 07 14:40:38.858048 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 111/208] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:40:38 2022] GET /compute/v2.1/servers/af1af1be-6244-4c4f-ac6a-918ace6e2f1d => generated 1553 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:40:39.405392 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-77339797-567f-4725-af3f-0d17cd042cf8 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:40:39.406138 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-77339797-567f-4725-af3f-0d17cd042cf8 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: ee2e782c-42ff-4093-9246-75d4e69929b3] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:40:39.408210 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG dbcounter [-] [118157] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=118157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:40:39.412965 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-77339797-567f-4725-af3f-0d17cd042cf8 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:39.413472 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-77339797-567f-4725-af3f-0d17cd042cf8 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:39.414263 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-77339797-567f-4725-af3f-0d17cd042cf8 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:39.414701 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-77339797-567f-4725-af3f-0d17cd042cf8 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:39.553637 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-77339797-567f-4725-af3f-0d17cd042cf8 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:40:39.562257 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-77339797-567f-4725-af3f-0d17cd042cf8 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3" status: 200 len: 1519 microversion: 2.1 time: 0.160661 Jun 07 14:40:39.562887 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 98/209] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:40:39 2022] GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3 => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:40:39.874528 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-ce931c4d-8f7a-45e0-8647-499c07c31246 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:40:39.875256 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-ce931c4d-8f7a-45e0-8647-499c07c31246 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] [instance: af1af1be-6244-4c4f-ac6a-918ace6e2f1d] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:40:39.882791 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-ce931c4d-8f7a-45e0-8647-499c07c31246 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:39.883239 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-ce931c4d-8f7a-45e0-8647-499c07c31246 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:39.884021 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-ce931c4d-8f7a-45e0-8647-499c07c31246 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:39.884574 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-ce931c4d-8f7a-45e0-8647-499c07c31246 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:40.042564 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-ce931c4d-8f7a-45e0-8647-499c07c31246 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd800b8efe792477bac3ca063920a4a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd7cee3f5704d01ae9df6d300b30004', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:40:40.050475 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-ce931c4d-8f7a-45e0-8647-499c07c31246 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] 10.222.0.85 "GET /compute/v2.1/servers/af1af1be-6244-4c4f-ac6a-918ace6e2f1d" status: 200 len: 1553 microversion: 2.1 time: 0.179843 Jun 07 14:40:40.051038 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 112/210] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:40:39 2022] GET /compute/v2.1/servers/af1af1be-6244-4c4f-ac6a-918ace6e2f1d => generated 1553 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:40:40.578966 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-da92bb55-6267-4aa0-8ae7-21aa49d4f575 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:40:40.580146 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-da92bb55-6267-4aa0-8ae7-21aa49d4f575 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: ee2e782c-42ff-4093-9246-75d4e69929b3] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:40:40.587369 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-da92bb55-6267-4aa0-8ae7-21aa49d4f575 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:40.587814 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-da92bb55-6267-4aa0-8ae7-21aa49d4f575 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:40.588614 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-da92bb55-6267-4aa0-8ae7-21aa49d4f575 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:40.589048 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-da92bb55-6267-4aa0-8ae7-21aa49d4f575 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:40.726827 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-da92bb55-6267-4aa0-8ae7-21aa49d4f575 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:40:40.736458 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-da92bb55-6267-4aa0-8ae7-21aa49d4f575 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3" status: 200 len: 1519 microversion: 2.1 time: 0.161209 Jun 07 14:40:40.737292 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 99/211] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:40:40 2022] GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3 => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:40:41.067599 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-e3f1eced-fb67-4b4f-8baf-ae2bdcf836bf tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:40:41.068998 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-e3f1eced-fb67-4b4f-8baf-ae2bdcf836bf tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] [instance: af1af1be-6244-4c4f-ac6a-918ace6e2f1d] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:40:41.080910 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-e3f1eced-fb67-4b4f-8baf-ae2bdcf836bf tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:41.081370 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-e3f1eced-fb67-4b4f-8baf-ae2bdcf836bf tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:41.082156 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-e3f1eced-fb67-4b4f-8baf-ae2bdcf836bf tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:41.082764 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-e3f1eced-fb67-4b4f-8baf-ae2bdcf836bf tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:41.228908 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-e3f1eced-fb67-4b4f-8baf-ae2bdcf836bf tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd800b8efe792477bac3ca063920a4a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd7cee3f5704d01ae9df6d300b30004', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:40:41.232552 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG dbcounter [-] [118158] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=118158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:40:41.237939 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-e3f1eced-fb67-4b4f-8baf-ae2bdcf836bf tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] 10.222.0.85 "GET /compute/v2.1/servers/af1af1be-6244-4c4f-ac6a-918ace6e2f1d" status: 200 len: 1553 microversion: 2.1 time: 0.174727 Jun 07 14:40:41.238523 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 113/212] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:40:41 2022] GET /compute/v2.1/servers/af1af1be-6244-4c4f-ac6a-918ace6e2f1d => generated 1553 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:40:41.677080 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [req-24060eb8-b0bf-48b8-bf54-5bb2a9a1f5ca req-eb7a8dd3-3da0-4ed8-a9c2-f254fbddae1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af1af1be-6244-4c4f-ac6a-918ace6e2f1d", "name": "network-vif-deleted", "tag": "a2f1eff0-8cba-4052-b98d-94d3f0238a13"}]} {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:40:41.691158 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [req-24060eb8-b0bf-48b8-bf54-5bb2a9a1f5ca req-eb7a8dd3-3da0-4ed8-a9c2-f254fbddae1d service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:41.692347 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [req-24060eb8-b0bf-48b8-bf54-5bb2a9a1f5ca req-eb7a8dd3-3da0-4ed8-a9c2-f254fbddae1d service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:41.712239 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.compute.server_external_events [req-24060eb8-b0bf-48b8-bf54-5bb2a9a1f5ca req-eb7a8dd3-3da0-4ed8-a9c2-f254fbddae1d service nova] Creating event network-vif-deleted:a2f1eff0-8cba-4052-b98d-94d3f0238a13 for instance af1af1be-6244-4c4f-ac6a-918ace6e2f1d on hv-cinder-84497 Jun 07 14:40:41.719717 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [req-24060eb8-b0bf-48b8-bf54-5bb2a9a1f5ca req-eb7a8dd3-3da0-4ed8-a9c2-f254fbddae1d service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047606 Jun 07 14:40:41.721663 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 100/213] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jun 7 14:40:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:40:41.755832 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-5d0d2bd0-aab3-43b8-a613-521a44d626d3 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:40:41.756493 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-5d0d2bd0-aab3-43b8-a613-521a44d626d3 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: ee2e782c-42ff-4093-9246-75d4e69929b3] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:40:41.764420 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5d0d2bd0-aab3-43b8-a613-521a44d626d3 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:41.764920 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5d0d2bd0-aab3-43b8-a613-521a44d626d3 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:41.765954 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5d0d2bd0-aab3-43b8-a613-521a44d626d3 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:41.766561 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5d0d2bd0-aab3-43b8-a613-521a44d626d3 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:41.930437 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-5d0d2bd0-aab3-43b8-a613-521a44d626d3 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:40:41.940702 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-5d0d2bd0-aab3-43b8-a613-521a44d626d3 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3" status: 200 len: 1519 microversion: 2.1 time: 0.188378 Jun 07 14:40:41.940702 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 114/214] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:40:41 2022] GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3 => generated 1519 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:40:42.258052 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-619af725-e130-4d7e-89bc-47a64fe08e4b tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:40:42.258294 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-619af725-e130-4d7e-89bc-47a64fe08e4b tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] [instance: af1af1be-6244-4c4f-ac6a-918ace6e2f1d] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:40:42.266145 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-619af725-e130-4d7e-89bc-47a64fe08e4b tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:42.266605 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-619af725-e130-4d7e-89bc-47a64fe08e4b tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:42.268103 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-619af725-e130-4d7e-89bc-47a64fe08e4b tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:42.268611 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-619af725-e130-4d7e-89bc-47a64fe08e4b tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:42.339340 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-619af725-e130-4d7e-89bc-47a64fe08e4b tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd800b8efe792477bac3ca063920a4a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd7cee3f5704d01ae9df6d300b30004', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:40:42.341826 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG dbcounter [-] [118157] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:40:42.349063 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-619af725-e130-4d7e-89bc-47a64fe08e4b tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] 10.222.0.85 "GET /compute/v2.1/servers/af1af1be-6244-4c4f-ac6a-918ace6e2f1d" status: 200 len: 1346 microversion: 2.1 time: 0.096096 Jun 07 14:40:42.349639 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 101/215] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:40:42 2022] GET /compute/v2.1/servers/af1af1be-6244-4c4f-ac6a-918ace6e2f1d => generated 1346 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:40:42.960781 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-8cb18972-2d76-4cee-b233-0889895028d6 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:40:42.962833 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-8cb18972-2d76-4cee-b233-0889895028d6 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: ee2e782c-42ff-4093-9246-75d4e69929b3] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:40:42.971736 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-8cb18972-2d76-4cee-b233-0889895028d6 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:42.972182 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-8cb18972-2d76-4cee-b233-0889895028d6 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:42.973155 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-8cb18972-2d76-4cee-b233-0889895028d6 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:42.975435 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-8cb18972-2d76-4cee-b233-0889895028d6 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:43.114958 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-8cb18972-2d76-4cee-b233-0889895028d6 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:40:43.123594 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-8cb18972-2d76-4cee-b233-0889895028d6 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3" status: 200 len: 1519 microversion: 2.1 time: 0.166605 Jun 07 14:40:43.124446 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 115/216] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:40:42 2022] GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3 => generated 1519 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:40:43.366909 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-5b32f15f-2b81-421f-b4df-4225b08dbadf tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:40:43.368094 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-5b32f15f-2b81-421f-b4df-4225b08dbadf tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] [instance: af1af1be-6244-4c4f-ac6a-918ace6e2f1d] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:40:43.375619 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-5b32f15f-2b81-421f-b4df-4225b08dbadf tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:43.376070 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-5b32f15f-2b81-421f-b4df-4225b08dbadf tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:43.377518 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-5b32f15f-2b81-421f-b4df-4225b08dbadf tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:43.377939 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-5b32f15f-2b81-421f-b4df-4225b08dbadf tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:43.413418 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-5b32f15f-2b81-421f-b4df-4225b08dbadf tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:43.414249 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-5b32f15f-2b81-421f-b4df-4225b08dbadf tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:43.414376 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.objects.instance [None req-5b32f15f-2b81-421f-b4df-4225b08dbadf tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lazy-loading 'fault' on Instance uuid af1af1be-6244-4c4f-ac6a-918ace6e2f1d {{(pid=118157) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 14:40:43.471589 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-5b32f15f-2b81-421f-b4df-4225b08dbadf tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd800b8efe792477bac3ca063920a4a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd7cee3f5704d01ae9df6d300b30004', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:40:43.478625 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-5b32f15f-2b81-421f-b4df-4225b08dbadf tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] 10.222.0.85 "GET /compute/v2.1/servers/af1af1be-6244-4c4f-ac6a-918ace6e2f1d" status: 200 len: 1305 microversion: 2.1 time: 0.115772 Jun 07 14:40:43.481809 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 102/217] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:40:43 2022] GET /compute/v2.1/servers/af1af1be-6244-4c4f-ac6a-918ace6e2f1d => generated 1305 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:40:44.141340 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-82941eee-5377-4959-b8d8-2c6acfd7da15 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:40:44.141957 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-82941eee-5377-4959-b8d8-2c6acfd7da15 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: ee2e782c-42ff-4093-9246-75d4e69929b3] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:40:44.148403 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-82941eee-5377-4959-b8d8-2c6acfd7da15 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:44.148861 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-82941eee-5377-4959-b8d8-2c6acfd7da15 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:44.149684 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-82941eee-5377-4959-b8d8-2c6acfd7da15 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:44.150125 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-82941eee-5377-4959-b8d8-2c6acfd7da15 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:44.285514 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-82941eee-5377-4959-b8d8-2c6acfd7da15 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:40:44.294358 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-82941eee-5377-4959-b8d8-2c6acfd7da15 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3" status: 200 len: 1519 microversion: 2.1 time: 0.157093 Jun 07 14:40:44.295248 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 116/218] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:40:44 2022] GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:40:44.496911 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-990d0f40-8284-449e-a28c-d34fbcfd61af tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:40:44.497430 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-990d0f40-8284-449e-a28c-d34fbcfd61af tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] [instance: af1af1be-6244-4c4f-ac6a-918ace6e2f1d] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:40:44.504248 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-990d0f40-8284-449e-a28c-d34fbcfd61af tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:44.504721 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-990d0f40-8284-449e-a28c-d34fbcfd61af tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:44.505478 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-990d0f40-8284-449e-a28c-d34fbcfd61af tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:44.506028 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-990d0f40-8284-449e-a28c-d34fbcfd61af tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:44.519661 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.wsgi [None req-990d0f40-8284-449e-a28c-d34fbcfd61af tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] HTTP exception thrown: Instance af1af1be-6244-4c4f-ac6a-918ace6e2f1d could not be found. Jun 07 14:40:44.533681 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-990d0f40-8284-449e-a28c-d34fbcfd61af tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Request method failure captured: Jun 07 14:40:44.533681 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: request: GET /compute/v2.1/servers/af1af1be-6244-4c4f-ac6a-918ace6e2f1d HTTP/1.1 Jun 07 14:40:44.533681 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Accept: application/json Jun 07 14:40:44.533681 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Accept-Encoding: identity Jun 07 14:40:44.533681 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Connection: close Jun 07 14:40:44.533681 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Content-Length: 0 Jun 07 14:40:44.533681 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Content-Type: application/json Jun 07 14:40:44.533681 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Host: 10.222.0.85 Jun 07 14:40:44.533681 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Openstack-System-Scope: None Jun 07 14:40:44.533681 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: User-Agent: python-urllib3/1.26.9 Jun 07 14:40:44.533681 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Auth-Token: gAAAAABin2MRUngx-fFdjUZcGuTtTFSt-mqzpLRjo0SUTel5siYZUMaf2rAC3uV5Fp3Q8102TXZd7-gCKy5aGbPAmLsGqAknPtxPPYbU647_Ifhs_1wcbdwPT5B4AekV0AttViGgILDh5W_b1NKmw65aKwU4FhX2xBeCyOrjplzUN39JerSixvE Jun 07 14:40:44.533681 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Domain-Id: None Jun 07 14:40:44.533681 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Domain-Name: None Jun 07 14:40:44.533681 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Identity-Status: Confirmed Jun 07 14:40:44.533681 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Is-Admin-Project: True Jun 07 14:40:44.533681 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Project-Domain-Id: default Jun 07 14:40:44.533681 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Project-Domain-Name: Default Jun 07 14:40:44.533681 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Project-Id: 1bd7cee3f5704d01ae9df6d300b30004 Jun 07 14:40:44.533681 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Project-Name: tempest-DeleteServersTestJSON-1266192193 Jun 07 14:40:44.533681 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Role: member,reader Jun 07 14:40:44.533681 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Roles: member,reader Jun 07 14:40:44.534938 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/1bd7cee3f5704d01ae9df6d300b30004"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_1bd7cee3f5704d01ae9df6d300b30004"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/1bd7cee3f5704d01ae9df6d300b30004"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/1bd7cee3f5704d01ae9df6d300b30004"}]}] Jun 07 14:40:44.534938 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Tenant: tempest-DeleteServersTestJSON-1266192193 Jun 07 14:40:44.534938 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Tenant-Id: 1bd7cee3f5704d01ae9df6d300b30004 Jun 07 14:40:44.534938 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Tenant-Name: tempest-DeleteServersTestJSON-1266192193 Jun 07 14:40:44.534938 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User: tempest-DeleteServersTestJSON-1266192193-project Jun 07 14:40:44.534938 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User-Domain-Id: default Jun 07 14:40:44.534938 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User-Domain-Name: Default Jun 07 14:40:44.534938 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User-Id: d800b8efe792477bac3ca063920a4a9a Jun 07 14:40:44.534938 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User-Name: tempest-DeleteServersTestJSON-1266192193-project Jun 07 14:40:44.534938 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: method: > Jun 07 14:40:44.534938 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: exception: Instance af1af1be-6244-4c4f-ac6a-918ace6e2f1d could not be found. Jun 07 14:40:44.534938 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: action_args: {'id': 'af1af1be-6244-4c4f-ac6a-918ace6e2f1d'} Jun 07 14:40:44.535618 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:40:44.535618 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:40:44.535618 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 14:40:44.535618 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 14:40:44.535618 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 14:40:44.535618 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 14:40:44.535618 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 14:40:44.535618 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 14:40:44.535618 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 14:40:44.535618 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 14:40:44.535618 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af1af1be-6244-4c4f-ac6a-918ace6e2f1d could not be found. Jun 07 14:40:44.535618 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:40:44.535618 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:40:44.535618 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:40:44.535618 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:40:44.535618 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:40:44.535618 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:40:44.535618 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:40:44.535618 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:40:44.535618 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:40:44.537125 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:40:44.537125 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 14:40:44.537125 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 14:40:44.537125 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 14:40:44.537125 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 14:40:44.537125 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 14:40:44.537125 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:40:44.537125 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af1af1be-6244-4c4f-ac6a-918ace6e2f1d could not be found. Jun 07 14:40:44.537125 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:40:44.537125 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:40:44.537125 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:40:44.537125 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:40:44.537125 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:40:44.537125 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:40:44.537125 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:40:44.537125 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:40:44.537125 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af1af1be-6244-4c4f-ac6a-918ace6e2f1d could not be found. Jun 07 14:40:44.537125 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:40:44.538646 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-990d0f40-8284-449e-a28c-d34fbcfd61af tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Returning 404 to user: Instance af1af1be-6244-4c4f-ac6a-918ace6e2f1d could not be found. {{(pid=118157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:40:44.538646 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-990d0f40-8284-449e-a28c-d34fbcfd61af tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] 10.222.0.85 "GET /compute/v2.1/servers/af1af1be-6244-4c4f-ac6a-918ace6e2f1d" status: 404 len: 111 microversion: 2.1 time: 0.042791 Jun 07 14:40:44.538646 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 103/219] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:40:44 2022] GET /compute/v2.1/servers/af1af1be-6244-4c4f-ac6a-918ace6e2f1d => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 14:40:44.645168 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-fc10556d-f188-4210-a74d-cd22d020e539 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:40:44.646105 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-fc10556d-f188-4210-a74d-cd22d020e539 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] [instance: af1af1be-6244-4c4f-ac6a-918ace6e2f1d] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:40:44.652237 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-fc10556d-f188-4210-a74d-cd22d020e539 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:44.652726 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-fc10556d-f188-4210-a74d-cd22d020e539 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:44.653499 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-fc10556d-f188-4210-a74d-cd22d020e539 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:44.654012 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-fc10556d-f188-4210-a74d-cd22d020e539 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:44.667415 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.wsgi [None req-fc10556d-f188-4210-a74d-cd22d020e539 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] HTTP exception thrown: Instance af1af1be-6244-4c4f-ac6a-918ace6e2f1d could not be found. Jun 07 14:40:44.681384 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-fc10556d-f188-4210-a74d-cd22d020e539 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Request method failure captured: Jun 07 14:40:44.681384 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: request: GET /compute/v2.1/servers/af1af1be-6244-4c4f-ac6a-918ace6e2f1d/os-volume_attachments HTTP/1.1 Jun 07 14:40:44.681384 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Accept: application/json Jun 07 14:40:44.681384 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Accept-Encoding: identity Jun 07 14:40:44.681384 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Connection: close Jun 07 14:40:44.681384 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Content-Length: 0 Jun 07 14:40:44.681384 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Content-Type: application/json Jun 07 14:40:44.681384 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Host: 10.222.0.85 Jun 07 14:40:44.681384 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Openstack-System-Scope: None Jun 07 14:40:44.681384 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: User-Agent: python-urllib3/1.26.9 Jun 07 14:40:44.681384 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Auth-Token: gAAAAABin2MRUngx-fFdjUZcGuTtTFSt-mqzpLRjo0SUTel5siYZUMaf2rAC3uV5Fp3Q8102TXZd7-gCKy5aGbPAmLsGqAknPtxPPYbU647_Ifhs_1wcbdwPT5B4AekV0AttViGgILDh5W_b1NKmw65aKwU4FhX2xBeCyOrjplzUN39JerSixvE Jun 07 14:40:44.681384 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Domain-Id: None Jun 07 14:40:44.681384 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Domain-Name: None Jun 07 14:40:44.681384 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Identity-Status: Confirmed Jun 07 14:40:44.681384 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Is-Admin-Project: True Jun 07 14:40:44.681384 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Domain-Id: default Jun 07 14:40:44.681384 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Domain-Name: Default Jun 07 14:40:44.681384 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Id: 1bd7cee3f5704d01ae9df6d300b30004 Jun 07 14:40:44.681384 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Name: tempest-DeleteServersTestJSON-1266192193 Jun 07 14:40:44.681384 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Role: member,reader Jun 07 14:40:44.681384 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Roles: member,reader Jun 07 14:40:44.682615 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/1bd7cee3f5704d01ae9df6d300b30004"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_1bd7cee3f5704d01ae9df6d300b30004"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/1bd7cee3f5704d01ae9df6d300b30004"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/1bd7cee3f5704d01ae9df6d300b30004"}]}] Jun 07 14:40:44.682615 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Tenant: tempest-DeleteServersTestJSON-1266192193 Jun 07 14:40:44.682615 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Tenant-Id: 1bd7cee3f5704d01ae9df6d300b30004 Jun 07 14:40:44.682615 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Tenant-Name: tempest-DeleteServersTestJSON-1266192193 Jun 07 14:40:44.682615 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User: tempest-DeleteServersTestJSON-1266192193-project Jun 07 14:40:44.682615 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Domain-Id: default Jun 07 14:40:44.682615 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Domain-Name: Default Jun 07 14:40:44.682615 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Id: d800b8efe792477bac3ca063920a4a9a Jun 07 14:40:44.682615 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Name: tempest-DeleteServersTestJSON-1266192193-project Jun 07 14:40:44.682615 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: method: > Jun 07 14:40:44.682615 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: exception: Instance af1af1be-6244-4c4f-ac6a-918ace6e2f1d could not be found. Jun 07 14:40:44.682615 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: action_args: {'server_id': 'af1af1be-6244-4c4f-ac6a-918ace6e2f1d'} Jun 07 14:40:44.683282 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:40:44.683282 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:40:44.683282 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 14:40:44.683282 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 14:40:44.683282 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 14:40:44.683282 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 14:40:44.683282 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 14:40:44.683282 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 14:40:44.683282 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 14:40:44.683282 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 14:40:44.683282 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af1af1be-6244-4c4f-ac6a-918ace6e2f1d could not be found. Jun 07 14:40:44.683282 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:40:44.683282 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:40:44.683282 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:40:44.683282 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:40:44.683282 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:40:44.683282 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:40:44.683282 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:40:44.683282 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:40:44.683282 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:40:44.690454 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:40:44.690454 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 07 14:40:44.690454 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 14:40:44.690454 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 07 14:40:44.690454 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 14:40:44.690454 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 07 14:40:44.690454 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 07 14:40:44.690454 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 14:40:44.690454 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:40:44.690454 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af1af1be-6244-4c4f-ac6a-918ace6e2f1d could not be found. Jun 07 14:40:44.690454 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:40:44.690454 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:40:44.690454 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:40:44.690454 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:40:44.690454 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:40:44.690454 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:40:44.690454 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:40:44.690454 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:40:44.690454 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af1af1be-6244-4c4f-ac6a-918ace6e2f1d could not be found. Jun 07 14:40:44.690454 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:40:44.691694 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-fc10556d-f188-4210-a74d-cd22d020e539 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Returning 404 to user: Instance af1af1be-6244-4c4f-ac6a-918ace6e2f1d could not be found. {{(pid=118158) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:40:44.691694 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-fc10556d-f188-4210-a74d-cd22d020e539 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] 10.222.0.85 "GET /compute/v2.1/servers/af1af1be-6244-4c4f-ac6a-918ace6e2f1d/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.042438 Jun 07 14:40:44.691694 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 117/220] 10.222.0.85 () {58 vars in 1301 bytes} [Tue Jun 7 14:40:44 2022] GET /compute/v2.1/servers/af1af1be-6244-4c4f-ac6a-918ace6e2f1d/os-volume_attachments => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 14:40:45.313264 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-39f28f14-75df-480e-9341-e2f1afce048c tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:40:45.313906 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-39f28f14-75df-480e-9341-e2f1afce048c tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: ee2e782c-42ff-4093-9246-75d4e69929b3] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:40:45.321115 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-39f28f14-75df-480e-9341-e2f1afce048c tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:45.321555 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-39f28f14-75df-480e-9341-e2f1afce048c tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:45.322339 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-39f28f14-75df-480e-9341-e2f1afce048c tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:45.322773 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-39f28f14-75df-480e-9341-e2f1afce048c tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:45.509138 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-39f28f14-75df-480e-9341-e2f1afce048c tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:40:45.517658 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-39f28f14-75df-480e-9341-e2f1afce048c tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3" status: 200 len: 1519 microversion: 2.1 time: 0.208080 Jun 07 14:40:45.518135 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 104/221] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:40:45 2022] GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3 => generated 1519 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:40:46.033497 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-6ee79ab7-60e5-42f2-a712-85f04f9e619b tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:40:46.034057 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-6ee79ab7-60e5-42f2-a712-85f04f9e619b tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] [instance: af1af1be-6244-4c4f-ac6a-918ace6e2f1d] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:40:46.040289 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-6ee79ab7-60e5-42f2-a712-85f04f9e619b tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:46.040778 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-6ee79ab7-60e5-42f2-a712-85f04f9e619b tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:46.042079 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-6ee79ab7-60e5-42f2-a712-85f04f9e619b tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:46.042079 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-6ee79ab7-60e5-42f2-a712-85f04f9e619b tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:46.056158 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.wsgi [None req-6ee79ab7-60e5-42f2-a712-85f04f9e619b tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] HTTP exception thrown: Instance af1af1be-6244-4c4f-ac6a-918ace6e2f1d could not be found. Jun 07 14:40:46.058684 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-6ee79ab7-60e5-42f2-a712-85f04f9e619b tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Request method failure captured: Jun 07 14:40:46.058684 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: request: DELETE /compute/v2.1/servers/af1af1be-6244-4c4f-ac6a-918ace6e2f1d HTTP/1.1 Jun 07 14:40:46.058684 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Accept: application/json Jun 07 14:40:46.058684 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Accept-Encoding: identity Jun 07 14:40:46.058684 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Connection: close Jun 07 14:40:46.058684 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Content-Length: 0 Jun 07 14:40:46.058684 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Content-Type: application/json Jun 07 14:40:46.058684 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Host: 10.222.0.85 Jun 07 14:40:46.058684 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Openstack-System-Scope: None Jun 07 14:40:46.058684 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: User-Agent: python-urllib3/1.26.9 Jun 07 14:40:46.058684 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Auth-Token: gAAAAABin2MRUngx-fFdjUZcGuTtTFSt-mqzpLRjo0SUTel5siYZUMaf2rAC3uV5Fp3Q8102TXZd7-gCKy5aGbPAmLsGqAknPtxPPYbU647_Ifhs_1wcbdwPT5B4AekV0AttViGgILDh5W_b1NKmw65aKwU4FhX2xBeCyOrjplzUN39JerSixvE Jun 07 14:40:46.058684 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Domain-Id: None Jun 07 14:40:46.058684 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Domain-Name: None Jun 07 14:40:46.058684 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Identity-Status: Confirmed Jun 07 14:40:46.058684 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Is-Admin-Project: True Jun 07 14:40:46.058684 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Domain-Id: default Jun 07 14:40:46.058684 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Domain-Name: Default Jun 07 14:40:46.058684 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Id: 1bd7cee3f5704d01ae9df6d300b30004 Jun 07 14:40:46.058684 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Name: tempest-DeleteServersTestJSON-1266192193 Jun 07 14:40:46.058684 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Role: member,reader Jun 07 14:40:46.058684 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Roles: member,reader Jun 07 14:40:46.060031 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/1bd7cee3f5704d01ae9df6d300b30004"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_1bd7cee3f5704d01ae9df6d300b30004"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/1bd7cee3f5704d01ae9df6d300b30004"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/1bd7cee3f5704d01ae9df6d300b30004"}]}] Jun 07 14:40:46.060031 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Tenant: tempest-DeleteServersTestJSON-1266192193 Jun 07 14:40:46.060031 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Tenant-Id: 1bd7cee3f5704d01ae9df6d300b30004 Jun 07 14:40:46.060031 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Tenant-Name: tempest-DeleteServersTestJSON-1266192193 Jun 07 14:40:46.060031 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User: tempest-DeleteServersTestJSON-1266192193-project Jun 07 14:40:46.060031 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Domain-Id: default Jun 07 14:40:46.060031 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Domain-Name: Default Jun 07 14:40:46.060031 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Id: d800b8efe792477bac3ca063920a4a9a Jun 07 14:40:46.060031 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Name: tempest-DeleteServersTestJSON-1266192193-project Jun 07 14:40:46.060031 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: method: > Jun 07 14:40:46.060031 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: exception: Instance af1af1be-6244-4c4f-ac6a-918ace6e2f1d could not be found. Jun 07 14:40:46.060031 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: action_args: {'id': 'af1af1be-6244-4c4f-ac6a-918ace6e2f1d'} Jun 07 14:40:46.061097 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:40:46.061097 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:40:46.061097 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 14:40:46.061097 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 14:40:46.061097 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 14:40:46.061097 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 14:40:46.061097 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 14:40:46.061097 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 14:40:46.061097 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 14:40:46.061097 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 14:40:46.061097 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af1af1be-6244-4c4f-ac6a-918ace6e2f1d could not be found. Jun 07 14:40:46.061097 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:40:46.061097 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:40:46.061097 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:40:46.061097 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:40:46.061097 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:40:46.061097 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:40:46.061097 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:40:46.061097 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:40:46.061097 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:40:46.062561 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:40:46.062561 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 07 14:40:46.062561 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 07 14:40:46.062561 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 07 14:40:46.062561 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 07 14:40:46.062561 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 14:40:46.062561 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 14:40:46.062561 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 14:40:46.062561 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:40:46.062561 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af1af1be-6244-4c4f-ac6a-918ace6e2f1d could not be found. Jun 07 14:40:46.062561 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:40:46.062561 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:40:46.062561 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:40:46.062561 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:40:46.062561 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:40:46.062561 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:40:46.062561 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:40:46.062561 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:40:46.062561 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af1af1be-6244-4c4f-ac6a-918ace6e2f1d could not be found. Jun 07 14:40:46.062561 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:40:46.065357 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-6ee79ab7-60e5-42f2-a712-85f04f9e619b tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Returning 404 to user: Instance af1af1be-6244-4c4f-ac6a-918ace6e2f1d could not be found. {{(pid=118158) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:40:46.065357 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-6ee79ab7-60e5-42f2-a712-85f04f9e619b tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] 10.222.0.85 "DELETE /compute/v2.1/servers/af1af1be-6244-4c4f-ac6a-918ace6e2f1d" status: 404 len: 111 microversion: 2.1 time: 0.030629 Jun 07 14:40:46.065357 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 118/222] 10.222.0.85 () {58 vars in 1238 bytes} [Tue Jun 7 14:40:46 2022] DELETE /compute/v2.1/servers/af1af1be-6244-4c4f-ac6a-918ace6e2f1d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 07 14:40:46.069616 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-6447c7b4-17b2-45e9-9132-8ffb3d25bc62 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:40:46.070133 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-6447c7b4-17b2-45e9-9132-8ffb3d25bc62 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] [instance: af1af1be-6244-4c4f-ac6a-918ace6e2f1d] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:40:46.076571 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-6447c7b4-17b2-45e9-9132-8ffb3d25bc62 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:46.077014 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-6447c7b4-17b2-45e9-9132-8ffb3d25bc62 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:46.077778 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-6447c7b4-17b2-45e9-9132-8ffb3d25bc62 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:46.078210 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-6447c7b4-17b2-45e9-9132-8ffb3d25bc62 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:46.100819 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.wsgi [None req-6447c7b4-17b2-45e9-9132-8ffb3d25bc62 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] HTTP exception thrown: Instance af1af1be-6244-4c4f-ac6a-918ace6e2f1d could not be found. Jun 07 14:40:46.100819 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-6447c7b4-17b2-45e9-9132-8ffb3d25bc62 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Request method failure captured: Jun 07 14:40:46.100819 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: request: GET /compute/v2.1/servers/af1af1be-6244-4c4f-ac6a-918ace6e2f1d HTTP/1.1 Jun 07 14:40:46.100819 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Accept: application/json Jun 07 14:40:46.100819 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Accept-Encoding: identity Jun 07 14:40:46.100819 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Connection: close Jun 07 14:40:46.100819 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Content-Length: 0 Jun 07 14:40:46.100819 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Content-Type: application/json Jun 07 14:40:46.100819 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Host: 10.222.0.85 Jun 07 14:40:46.100819 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Openstack-System-Scope: None Jun 07 14:40:46.100819 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: User-Agent: python-urllib3/1.26.9 Jun 07 14:40:46.100819 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Auth-Token: gAAAAABin2MRUngx-fFdjUZcGuTtTFSt-mqzpLRjo0SUTel5siYZUMaf2rAC3uV5Fp3Q8102TXZd7-gCKy5aGbPAmLsGqAknPtxPPYbU647_Ifhs_1wcbdwPT5B4AekV0AttViGgILDh5W_b1NKmw65aKwU4FhX2xBeCyOrjplzUN39JerSixvE Jun 07 14:40:46.100819 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Domain-Id: None Jun 07 14:40:46.100819 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Domain-Name: None Jun 07 14:40:46.100819 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Identity-Status: Confirmed Jun 07 14:40:46.100819 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Is-Admin-Project: True Jun 07 14:40:46.100819 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Project-Domain-Id: default Jun 07 14:40:46.100819 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Project-Domain-Name: Default Jun 07 14:40:46.100819 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Project-Id: 1bd7cee3f5704d01ae9df6d300b30004 Jun 07 14:40:46.100819 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Project-Name: tempest-DeleteServersTestJSON-1266192193 Jun 07 14:40:46.100819 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Role: member,reader Jun 07 14:40:46.100819 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Roles: member,reader Jun 07 14:40:46.103177 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/1bd7cee3f5704d01ae9df6d300b30004"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_1bd7cee3f5704d01ae9df6d300b30004"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/1bd7cee3f5704d01ae9df6d300b30004"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/1bd7cee3f5704d01ae9df6d300b30004"}]}] Jun 07 14:40:46.103177 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Tenant: tempest-DeleteServersTestJSON-1266192193 Jun 07 14:40:46.103177 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Tenant-Id: 1bd7cee3f5704d01ae9df6d300b30004 Jun 07 14:40:46.103177 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Tenant-Name: tempest-DeleteServersTestJSON-1266192193 Jun 07 14:40:46.103177 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User: tempest-DeleteServersTestJSON-1266192193-project Jun 07 14:40:46.103177 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User-Domain-Id: default Jun 07 14:40:46.103177 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User-Domain-Name: Default Jun 07 14:40:46.103177 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User-Id: d800b8efe792477bac3ca063920a4a9a Jun 07 14:40:46.103177 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User-Name: tempest-DeleteServersTestJSON-1266192193-project Jun 07 14:40:46.103177 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: method: > Jun 07 14:40:46.103177 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: exception: Instance af1af1be-6244-4c4f-ac6a-918ace6e2f1d could not be found. Jun 07 14:40:46.103177 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: action_args: {'id': 'af1af1be-6244-4c4f-ac6a-918ace6e2f1d'} Jun 07 14:40:46.104174 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:40:46.104174 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:40:46.104174 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 14:40:46.104174 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 14:40:46.104174 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 14:40:46.104174 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 14:40:46.104174 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 14:40:46.104174 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 14:40:46.104174 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 14:40:46.104174 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 14:40:46.104174 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af1af1be-6244-4c4f-ac6a-918ace6e2f1d could not be found. Jun 07 14:40:46.104174 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:40:46.104174 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:40:46.104174 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:40:46.104174 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:40:46.104174 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:40:46.104174 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:40:46.104174 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:40:46.104174 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:40:46.104174 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:40:46.106318 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:40:46.106318 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 14:40:46.106318 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 14:40:46.106318 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 14:40:46.106318 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 14:40:46.106318 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 14:40:46.106318 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:40:46.106318 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af1af1be-6244-4c4f-ac6a-918ace6e2f1d could not be found. Jun 07 14:40:46.106318 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:40:46.106318 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:40:46.106318 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:40:46.106318 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:40:46.106318 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:40:46.106318 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:40:46.106318 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:40:46.106318 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:40:46.106318 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af1af1be-6244-4c4f-ac6a-918ace6e2f1d could not be found. Jun 07 14:40:46.106318 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:40:46.107769 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-6447c7b4-17b2-45e9-9132-8ffb3d25bc62 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] Returning 404 to user: Instance af1af1be-6244-4c4f-ac6a-918ace6e2f1d could not be found. {{(pid=118157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:40:46.107769 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-6447c7b4-17b2-45e9-9132-8ffb3d25bc62 tempest-DeleteServersTestJSON-1266192193 tempest-DeleteServersTestJSON-1266192193-project] 10.222.0.85 "GET /compute/v2.1/servers/af1af1be-6244-4c4f-ac6a-918ace6e2f1d" status: 404 len: 111 microversion: 2.1 time: 0.030487 Jun 07 14:40:46.107769 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 105/223] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:40:46 2022] GET /compute/v2.1/servers/af1af1be-6244-4c4f-ac6a-918ace6e2f1d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 14:40:46.536170 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-ead47c5a-1d5e-465e-a0a0-e48729b3f862 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:40:46.537027 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-ead47c5a-1d5e-465e-a0a0-e48729b3f862 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: ee2e782c-42ff-4093-9246-75d4e69929b3] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:40:46.543101 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-ead47c5a-1d5e-465e-a0a0-e48729b3f862 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:46.543593 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-ead47c5a-1d5e-465e-a0a0-e48729b3f862 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:46.544606 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-ead47c5a-1d5e-465e-a0a0-e48729b3f862 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:46.547388 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-ead47c5a-1d5e-465e-a0a0-e48729b3f862 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:46.848231 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-ead47c5a-1d5e-465e-a0a0-e48729b3f862 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:40:46.856596 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-ead47c5a-1d5e-465e-a0a0-e48729b3f862 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3" status: 200 len: 1519 microversion: 2.1 time: 0.325289 Jun 07 14:40:46.860404 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 119/224] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:40:46 2022] GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3 => generated 1519 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:40:47.873510 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-f46e7f1b-828a-4fec-84bc-2b229770e734 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:40:47.874336 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-f46e7f1b-828a-4fec-84bc-2b229770e734 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: ee2e782c-42ff-4093-9246-75d4e69929b3] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:40:47.882200 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-f46e7f1b-828a-4fec-84bc-2b229770e734 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:47.882647 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-f46e7f1b-828a-4fec-84bc-2b229770e734 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:47.883578 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-f46e7f1b-828a-4fec-84bc-2b229770e734 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:47.884005 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-f46e7f1b-828a-4fec-84bc-2b229770e734 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:48.023496 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-f46e7f1b-828a-4fec-84bc-2b229770e734 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:40:48.031647 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-f46e7f1b-828a-4fec-84bc-2b229770e734 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3" status: 200 len: 1519 microversion: 2.1 time: 0.162203 Jun 07 14:40:48.032204 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 106/225] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:40:47 2022] GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3 => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:40:49.051570 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-a6fec1e2-d7a7-4d74-9f61-e73f49d18230 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:40:49.052186 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-a6fec1e2-d7a7-4d74-9f61-e73f49d18230 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: ee2e782c-42ff-4093-9246-75d4e69929b3] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:40:49.058256 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-a6fec1e2-d7a7-4d74-9f61-e73f49d18230 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:49.058714 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-a6fec1e2-d7a7-4d74-9f61-e73f49d18230 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:49.059480 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-a6fec1e2-d7a7-4d74-9f61-e73f49d18230 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:49.059917 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-a6fec1e2-d7a7-4d74-9f61-e73f49d18230 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:49.210457 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-a6fec1e2-d7a7-4d74-9f61-e73f49d18230 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:40:49.218122 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-a6fec1e2-d7a7-4d74-9f61-e73f49d18230 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3" status: 200 len: 1519 microversion: 2.1 time: 0.170909 Jun 07 14:40:49.218853 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 120/226] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:40:49 2022] GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3 => generated 1519 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:40:50.237178 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-b36bc988-f24d-4ecc-bc12-f6d07ff69137 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:40:50.238599 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-b36bc988-f24d-4ecc-bc12-f6d07ff69137 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: ee2e782c-42ff-4093-9246-75d4e69929b3] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:40:50.245833 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-b36bc988-f24d-4ecc-bc12-f6d07ff69137 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:50.246363 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-b36bc988-f24d-4ecc-bc12-f6d07ff69137 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:50.247251 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-b36bc988-f24d-4ecc-bc12-f6d07ff69137 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:50.247759 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-b36bc988-f24d-4ecc-bc12-f6d07ff69137 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:50.408412 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-b36bc988-f24d-4ecc-bc12-f6d07ff69137 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:40:50.416199 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-b36bc988-f24d-4ecc-bc12-f6d07ff69137 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3" status: 200 len: 1519 microversion: 2.1 time: 0.182625 Jun 07 14:40:50.417968 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 107/227] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:40:50 2022] GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3 => generated 1519 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:40:51.435252 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-7aa31668-9258-4548-8b7a-cf945ff40262 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:40:51.436501 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-7aa31668-9258-4548-8b7a-cf945ff40262 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: ee2e782c-42ff-4093-9246-75d4e69929b3] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:40:51.443212 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-7aa31668-9258-4548-8b7a-cf945ff40262 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:51.443866 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-7aa31668-9258-4548-8b7a-cf945ff40262 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:51.444967 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-7aa31668-9258-4548-8b7a-cf945ff40262 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:51.445584 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-7aa31668-9258-4548-8b7a-cf945ff40262 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:51.635243 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-7aa31668-9258-4548-8b7a-cf945ff40262 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:40:51.649269 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-7aa31668-9258-4548-8b7a-cf945ff40262 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3" status: 200 len: 1519 microversion: 2.1 time: 0.213043 Jun 07 14:40:51.649269 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 121/228] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:40:51 2022] GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3 => generated 1519 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:40:52.664283 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-d4d727cb-b825-4a48-aeac-c999baabdfe3 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:40:52.665157 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-d4d727cb-b825-4a48-aeac-c999baabdfe3 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: ee2e782c-42ff-4093-9246-75d4e69929b3] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:40:52.672069 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-d4d727cb-b825-4a48-aeac-c999baabdfe3 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:52.672551 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-d4d727cb-b825-4a48-aeac-c999baabdfe3 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:52.673315 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-d4d727cb-b825-4a48-aeac-c999baabdfe3 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:52.673750 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-d4d727cb-b825-4a48-aeac-c999baabdfe3 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:52.836204 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-d4d727cb-b825-4a48-aeac-c999baabdfe3 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:40:52.844765 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-d4d727cb-b825-4a48-aeac-c999baabdfe3 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3" status: 200 len: 1519 microversion: 2.1 time: 0.184172 Jun 07 14:40:52.845491 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 108/229] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:40:52 2022] GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3 => generated 1519 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:40:53.862970 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-2865e2da-4e52-4d87-9c4d-ca6095dc53ae tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:40:53.864643 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-2865e2da-4e52-4d87-9c4d-ca6095dc53ae tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: ee2e782c-42ff-4093-9246-75d4e69929b3] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:40:53.873170 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-2865e2da-4e52-4d87-9c4d-ca6095dc53ae tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:53.873641 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-2865e2da-4e52-4d87-9c4d-ca6095dc53ae tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:53.875275 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-2865e2da-4e52-4d87-9c4d-ca6095dc53ae tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:53.876828 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-2865e2da-4e52-4d87-9c4d-ca6095dc53ae tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:54.068403 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-2865e2da-4e52-4d87-9c4d-ca6095dc53ae tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:40:54.078904 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-2865e2da-4e52-4d87-9c4d-ca6095dc53ae tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3" status: 200 len: 1519 microversion: 2.1 time: 0.221107 Jun 07 14:40:54.080491 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 122/230] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:40:53 2022] GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3 => generated 1519 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:40:55.099424 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-e4b3386e-5e45-40dd-8334-3022ac2b8e85 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:40:55.101478 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-e4b3386e-5e45-40dd-8334-3022ac2b8e85 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: ee2e782c-42ff-4093-9246-75d4e69929b3] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:40:55.113380 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-e4b3386e-5e45-40dd-8334-3022ac2b8e85 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:55.113961 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-e4b3386e-5e45-40dd-8334-3022ac2b8e85 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:55.114752 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-e4b3386e-5e45-40dd-8334-3022ac2b8e85 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:55.115207 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-e4b3386e-5e45-40dd-8334-3022ac2b8e85 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:55.384015 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-e4b3386e-5e45-40dd-8334-3022ac2b8e85 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:40:55.393086 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-e4b3386e-5e45-40dd-8334-3022ac2b8e85 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3" status: 200 len: 1519 microversion: 2.1 time: 0.299165 Jun 07 14:40:55.400908 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 109/231] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:40:55 2022] GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3 => generated 1519 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:40:56.213389 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-6663f4f2-4466-4142-b3a0-a6006cc83206 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Action: 'create', calling method: .version_select at 0x7f5f8819b9d0>, body: {"keypair": {"name": "tempest-keypair-2113095407", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNNB26iplvRVoyVNtWwELXHbZyAn5XbBa1AK9s+Ri+IeffRjCHi9kTE//A7kbN3RbGMlrT+Z56uH/KN2NrL580oXhvODD3JPG0TzX8DGfo54PznvGsiAT/mzj1N4vJTCLg=="}} {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:40:56.217255 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG dbcounter [-] [118158] Writing DB stats nova_api:SELECT=46 {{(pid=118158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:40:56.228902 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.quota [None req-6663f4f2-4466-4142-b3a0-a6006cc83206 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Getting quotas for project 6714e8cfaee34ac3af916af5e4bb1031. Resources: {'key_pairs'} {{(pid=118158) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 14:40:56.233386 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.quota [None req-6663f4f2-4466-4142-b3a0-a6006cc83206 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Getting quotas for user ed3353d3d8a242e1a6b54d31adf97a6d and project 6714e8cfaee34ac3af916af5e4bb1031. Resources: {'key_pairs'} {{(pid=118158) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 14:40:56.325369 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-6663f4f2-4466-4142-b3a0-a6006cc83206 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.242086 Jun 07 14:40:56.325964 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 123/232] 10.222.0.85 () {62 vars in 1199 bytes} [Tue Jun 7 14:40:56 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 244 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 07 14:40:56.411931 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-c01b5cc2-15b0-4efa-bb1f-30b73df849ce tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:40:56.412497 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-c01b5cc2-15b0-4efa-bb1f-30b73df849ce tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: ee2e782c-42ff-4093-9246-75d4e69929b3] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:40:56.419236 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-c01b5cc2-15b0-4efa-bb1f-30b73df849ce tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:56.419801 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-c01b5cc2-15b0-4efa-bb1f-30b73df849ce tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:56.420644 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-c01b5cc2-15b0-4efa-bb1f-30b73df849ce tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:56.421165 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-c01b5cc2-15b0-4efa-bb1f-30b73df849ce tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:56.602648 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-c01b5cc2-15b0-4efa-bb1f-30b73df849ce tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:40:56.610381 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-c01b5cc2-15b0-4efa-bb1f-30b73df849ce tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3" status: 200 len: 1519 microversion: 2.1 time: 0.203086 Jun 07 14:40:56.610973 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 110/233] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:40:56 2022] GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3 => generated 1519 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:40:57.631111 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-9b24e015-a6bd-40dc-9276-4117d1cabcd2 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:40:57.632467 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-9b24e015-a6bd-40dc-9276-4117d1cabcd2 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: ee2e782c-42ff-4093-9246-75d4e69929b3] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:40:57.639315 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-9b24e015-a6bd-40dc-9276-4117d1cabcd2 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:57.640338 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-9b24e015-a6bd-40dc-9276-4117d1cabcd2 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:57.641388 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-9b24e015-a6bd-40dc-9276-4117d1cabcd2 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:57.642566 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-9b24e015-a6bd-40dc-9276-4117d1cabcd2 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:57.885351 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-9b24e015-a6bd-40dc-9276-4117d1cabcd2 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:40:57.896481 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-9b24e015-a6bd-40dc-9276-4117d1cabcd2 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3" status: 200 len: 1519 microversion: 2.1 time: 0.269976 Jun 07 14:40:57.897619 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 124/234] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:40:57 2022] GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3 => generated 1519 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:40:58.896492 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-303129d0-e479-4f58-81f1-d27318900de0 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1850112288", "imageRef": "7802ce25-d370-43a3-8d85-0257d644d539", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ba36f3f4-89b1-428d-a708-1cf3e01cddd9"}], "security_groups": [{"name": "tempest-securitygroup--1605143353"}], "key_name": "tempest-keypair-2113095407", "user_data": "}} {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:40:58.913625 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-ffa7a288-4de7-4123-840f-56ff318c98c6 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:40:58.915083 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-ffa7a288-4de7-4123-840f-56ff318c98c6 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: ee2e782c-42ff-4093-9246-75d4e69929b3] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:40:58.922084 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-ffa7a288-4de7-4123-840f-56ff318c98c6 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:58.923171 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-ffa7a288-4de7-4123-840f-56ff318c98c6 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:58.924329 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-ffa7a288-4de7-4123-840f-56ff318c98c6 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:58.924990 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-ffa7a288-4de7-4123-840f-56ff318c98c6 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:59.037141 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.network.neutron [None req-303129d0-e479-4f58-81f1-d27318900de0 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] validate_networks() for [('ba36f3f4-89b1-428d-a708-1cf3e01cddd9', None, None, None, None, None)] {{(pid=118157) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 14:40:59.092106 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-ffa7a288-4de7-4123-840f-56ff318c98c6 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:40:59.107323 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-ffa7a288-4de7-4123-840f-56ff318c98c6 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3" status: 200 len: 1519 microversion: 2.1 time: 0.197373 Jun 07 14:40:59.108199 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 125/235] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:40:58 2022] GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3 => generated 1519 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:40:59.512311 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.virt.hardware [None req-303129d0-e479-4f58-81f1-d27318900de0 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Flavor limits 0:0:0 {{(pid=118157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 14:40:59.512753 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.virt.hardware [None req-303129d0-e479-4f58-81f1-d27318900de0 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Image limits 0:0:0 {{(pid=118157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 14:40:59.513223 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.virt.hardware [None req-303129d0-e479-4f58-81f1-d27318900de0 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Flavor pref 0:0:0 {{(pid=118157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 14:40:59.513902 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.virt.hardware [None req-303129d0-e479-4f58-81f1-d27318900de0 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Image pref 0:0:0 {{(pid=118157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 14:40:59.514309 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.virt.hardware [None req-303129d0-e479-4f58-81f1-d27318900de0 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 14:40:59.524331 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-303129d0-e479-4f58-81f1-d27318900de0 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:59.524847 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-303129d0-e479-4f58-81f1-d27318900de0 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:59.525638 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-303129d0-e479-4f58-81f1-d27318900de0 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:40:59.528840 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-303129d0-e479-4f58-81f1-d27318900de0 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:40:59.544139 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.quota [None req-303129d0-e479-4f58-81f1-d27318900de0 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Getting quotas for project 6714e8cfaee34ac3af916af5e4bb1031. Resources: {'instances', 'cores', 'ram'} {{(pid=118157) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 14:40:59.548597 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.quota [None req-303129d0-e479-4f58-81f1-d27318900de0 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Getting quotas for user ed3353d3d8a242e1a6b54d31adf97a6d and project 6714e8cfaee34ac3af916af5e4bb1031. Resources: {'instances', 'cores', 'ram'} {{(pid=118157) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 14:40:59.560031 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-303129d0-e479-4f58-81f1-d27318900de0 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Going to run 1 instances... {{(pid=118157) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 14:40:59.562565 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-303129d0-e479-4f58-81f1-d27318900de0 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7802ce25-d370-43a3-8d85-0257d644d539',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118157) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 14:40:59.732076 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-303129d0-e479-4f58-81f1-d27318900de0 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.839747 Jun 07 14:40:59.738870 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 111/236] 10.222.0.85 () {62 vars in 1187 bytes} [Tue Jun 7 14:40:58 2022] POST /compute/v2.1/servers => generated 402 bytes in 847 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 07 14:40:59.745998 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-11caf6d1-df97-4bab-9571-63d20e1c675a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:40:59.752529 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-11caf6d1-df97-4bab-9571-63d20e1c675a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:40:59.821537 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-11caf6d1-df97-4bab-9571-63d20e1c675a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:40:59.832614 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-11caf6d1-df97-4bab-9571-63d20e1c675a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:40:59.838943 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-11caf6d1-df97-4bab-9571-63d20e1c675a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:40:59.838943 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-11caf6d1-df97-4bab-9571-63d20e1c675a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1282 microversion: 2.20 time: 0.094516 Jun 07 14:40:59.838943 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 126/237] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:40:59 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1282 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:41:00.125372 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-d171b5c2-7fda-449a-afd2-0598d05a905f tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:41:00.125886 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-d171b5c2-7fda-449a-afd2-0598d05a905f tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: ee2e782c-42ff-4093-9246-75d4e69929b3] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:41:00.133366 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-d171b5c2-7fda-449a-afd2-0598d05a905f tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:00.135113 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-d171b5c2-7fda-449a-afd2-0598d05a905f tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:00.135891 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-d171b5c2-7fda-449a-afd2-0598d05a905f tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:00.136330 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-d171b5c2-7fda-449a-afd2-0598d05a905f tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:00.276400 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-d171b5c2-7fda-449a-afd2-0598d05a905f tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:00.284033 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-d171b5c2-7fda-449a-afd2-0598d05a905f tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3" status: 200 len: 1519 microversion: 2.1 time: 0.163352 Jun 07 14:41:00.284603 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 112/238] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:41:00 2022] GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3 => generated 1519 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:41:00.854923 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-e85c83e8-624d-4f83-8cd0-7159514cc1d7 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:41:00.855538 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-e85c83e8-624d-4f83-8cd0-7159514cc1d7 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:41:00.861688 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-e85c83e8-624d-4f83-8cd0-7159514cc1d7 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:00.862145 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-e85c83e8-624d-4f83-8cd0-7159514cc1d7 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:00.862911 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-e85c83e8-624d-4f83-8cd0-7159514cc1d7 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:00.863348 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-e85c83e8-624d-4f83-8cd0-7159514cc1d7 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:00.923883 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-e85c83e8-624d-4f83-8cd0-7159514cc1d7 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:00.931741 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-e85c83e8-624d-4f83-8cd0-7159514cc1d7 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:00.933247 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-e85c83e8-624d-4f83-8cd0-7159514cc1d7 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:00.934338 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-e85c83e8-624d-4f83-8cd0-7159514cc1d7 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1286 microversion: 2.20 time: 0.083446 Jun 07 14:41:00.934890 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 127/239] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:41:00 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1286 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:41:01.302307 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-f248f6a5-de3c-4010-957c-2ef416bdf0e7 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:41:01.303040 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-f248f6a5-de3c-4010-957c-2ef416bdf0e7 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: ee2e782c-42ff-4093-9246-75d4e69929b3] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:41:01.309243 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-f248f6a5-de3c-4010-957c-2ef416bdf0e7 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:01.309717 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-f248f6a5-de3c-4010-957c-2ef416bdf0e7 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:01.310467 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-f248f6a5-de3c-4010-957c-2ef416bdf0e7 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:01.310932 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-f248f6a5-de3c-4010-957c-2ef416bdf0e7 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:01.445068 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-f248f6a5-de3c-4010-957c-2ef416bdf0e7 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:01.453046 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-f248f6a5-de3c-4010-957c-2ef416bdf0e7 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3" status: 200 len: 1519 microversion: 2.1 time: 0.155843 Jun 07 14:41:01.453605 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 113/240] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:41:01 2022] GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:41:01.952877 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-338077d8-315d-462c-82d4-1d5005741bcd tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:41:01.953496 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-338077d8-315d-462c-82d4-1d5005741bcd tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:41:01.960354 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-338077d8-315d-462c-82d4-1d5005741bcd tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:01.960840 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-338077d8-315d-462c-82d4-1d5005741bcd tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:01.961810 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-338077d8-315d-462c-82d4-1d5005741bcd tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:01.962760 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-338077d8-315d-462c-82d4-1d5005741bcd tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:02.026721 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-338077d8-315d-462c-82d4-1d5005741bcd tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:02.034644 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-338077d8-315d-462c-82d4-1d5005741bcd tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:02.036157 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-338077d8-315d-462c-82d4-1d5005741bcd tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:02.037313 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-338077d8-315d-462c-82d4-1d5005741bcd tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1278 microversion: 2.20 time: 0.088309 Jun 07 14:41:02.037871 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 128/241] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:41:01 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1278 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:41:02.471522 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-4ef65c5f-730c-431d-8e46-a978c6dd86b1 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:41:02.472140 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-4ef65c5f-730c-431d-8e46-a978c6dd86b1 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: ee2e782c-42ff-4093-9246-75d4e69929b3] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:41:02.481315 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-4ef65c5f-730c-431d-8e46-a978c6dd86b1 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:02.481761 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-4ef65c5f-730c-431d-8e46-a978c6dd86b1 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:02.482527 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-4ef65c5f-730c-431d-8e46-a978c6dd86b1 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:02.483006 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-4ef65c5f-730c-431d-8e46-a978c6dd86b1 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:02.632691 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-4ef65c5f-730c-431d-8e46-a978c6dd86b1 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:02.645254 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-4ef65c5f-730c-431d-8e46-a978c6dd86b1 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3" status: 200 len: 1519 microversion: 2.1 time: 0.178752 Jun 07 14:41:02.645844 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 114/242] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:41:02 2022] GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3 => generated 1519 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:41:03.056101 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-831e16b0-5061-4da4-aced-db4604481462 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:41:03.057064 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-831e16b0-5061-4da4-aced-db4604481462 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:41:03.063030 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-831e16b0-5061-4da4-aced-db4604481462 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:03.063482 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-831e16b0-5061-4da4-aced-db4604481462 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:03.064246 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-831e16b0-5061-4da4-aced-db4604481462 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:03.064747 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-831e16b0-5061-4da4-aced-db4604481462 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:03.130936 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-831e16b0-5061-4da4-aced-db4604481462 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:03.139385 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-831e16b0-5061-4da4-aced-db4604481462 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:03.141328 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-831e16b0-5061-4da4-aced-db4604481462 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:03.142458 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-831e16b0-5061-4da4-aced-db4604481462 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1342 microversion: 2.20 time: 0.090678 Jun 07 14:41:03.143237 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 129/243] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:41:03 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1342 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:41:03.662003 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-84c15091-718c-47c6-8456-cb08414ca650 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:41:03.662741 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-84c15091-718c-47c6-8456-cb08414ca650 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: ee2e782c-42ff-4093-9246-75d4e69929b3] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:41:03.669148 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-84c15091-718c-47c6-8456-cb08414ca650 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:03.669593 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-84c15091-718c-47c6-8456-cb08414ca650 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:03.670349 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-84c15091-718c-47c6-8456-cb08414ca650 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:03.670780 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-84c15091-718c-47c6-8456-cb08414ca650 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:03.934921 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-84c15091-718c-47c6-8456-cb08414ca650 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:03.944837 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-84c15091-718c-47c6-8456-cb08414ca650 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3" status: 200 len: 1519 microversion: 2.1 time: 0.286605 Jun 07 14:41:03.945938 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 115/244] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:41:03 2022] GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3 => generated 1519 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:41:04.160757 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-1c9dd07d-6fc8-4b55-8d57-9944e9dcd039 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:41:04.161404 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-1c9dd07d-6fc8-4b55-8d57-9944e9dcd039 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:41:04.168481 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-1c9dd07d-6fc8-4b55-8d57-9944e9dcd039 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:04.168939 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-1c9dd07d-6fc8-4b55-8d57-9944e9dcd039 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:04.169710 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-1c9dd07d-6fc8-4b55-8d57-9944e9dcd039 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:04.170149 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-1c9dd07d-6fc8-4b55-8d57-9944e9dcd039 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:04.301003 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-1c9dd07d-6fc8-4b55-8d57-9944e9dcd039 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:04.309077 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-1c9dd07d-6fc8-4b55-8d57-9944e9dcd039 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:04.310571 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-1c9dd07d-6fc8-4b55-8d57-9944e9dcd039 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:04.311677 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-1c9dd07d-6fc8-4b55-8d57-9944e9dcd039 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1408 microversion: 2.20 time: 0.154936 Jun 07 14:41:04.312235 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 130/245] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:41:04 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1408 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:41:04.964070 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-16efa776-883b-4d8b-a3b4-71558a0bc24f tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:41:04.964737 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-16efa776-883b-4d8b-a3b4-71558a0bc24f tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: ee2e782c-42ff-4093-9246-75d4e69929b3] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:41:04.971188 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-16efa776-883b-4d8b-a3b4-71558a0bc24f tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:04.972300 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-16efa776-883b-4d8b-a3b4-71558a0bc24f tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:04.973108 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-16efa776-883b-4d8b-a3b4-71558a0bc24f tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:04.973570 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-16efa776-883b-4d8b-a3b4-71558a0bc24f tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:05.104695 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-16efa776-883b-4d8b-a3b4-71558a0bc24f tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:05.112322 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-16efa776-883b-4d8b-a3b4-71558a0bc24f tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3" status: 200 len: 1519 microversion: 2.1 time: 0.153977 Jun 07 14:41:05.112907 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 116/246] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:41:04 2022] GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:41:05.330485 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-c233c1d2-bf14-429f-8449-f8c26963bc28 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:41:05.331616 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-c233c1d2-bf14-429f-8449-f8c26963bc28 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:41:05.337636 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-c233c1d2-bf14-429f-8449-f8c26963bc28 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:05.338089 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-c233c1d2-bf14-429f-8449-f8c26963bc28 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:05.338847 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-c233c1d2-bf14-429f-8449-f8c26963bc28 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:05.339277 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-c233c1d2-bf14-429f-8449-f8c26963bc28 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:05.470667 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-c233c1d2-bf14-429f-8449-f8c26963bc28 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:05.478579 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-c233c1d2-bf14-429f-8449-f8c26963bc28 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:05.480086 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-c233c1d2-bf14-429f-8449-f8c26963bc28 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:05.481229 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-c233c1d2-bf14-429f-8449-f8c26963bc28 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1408 microversion: 2.20 time: 0.154581 Jun 07 14:41:05.481797 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 131/247] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:41:05 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1408 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:41:06.130512 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-d4f5d2e1-60ad-4091-8434-a31f95bc409f tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:41:06.131127 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-d4f5d2e1-60ad-4091-8434-a31f95bc409f tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: ee2e782c-42ff-4093-9246-75d4e69929b3] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:41:06.137849 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-d4f5d2e1-60ad-4091-8434-a31f95bc409f tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:06.138303 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-d4f5d2e1-60ad-4091-8434-a31f95bc409f tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:06.139341 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-d4f5d2e1-60ad-4091-8434-a31f95bc409f tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:06.139776 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-d4f5d2e1-60ad-4091-8434-a31f95bc409f tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:06.271059 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-d4f5d2e1-60ad-4091-8434-a31f95bc409f tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:06.278541 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-d4f5d2e1-60ad-4091-8434-a31f95bc409f tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3" status: 200 len: 1519 microversion: 2.1 time: 0.152555 Jun 07 14:41:06.279096 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 117/248] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:41:06 2022] GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3 => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:41:06.499164 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-f128cc5c-0f60-484f-962a-b1d12f8b0021 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:41:06.499718 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-f128cc5c-0f60-484f-962a-b1d12f8b0021 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:41:06.506418 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-f128cc5c-0f60-484f-962a-b1d12f8b0021 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:06.506872 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-f128cc5c-0f60-484f-962a-b1d12f8b0021 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:06.507642 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-f128cc5c-0f60-484f-962a-b1d12f8b0021 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:06.508081 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-f128cc5c-0f60-484f-962a-b1d12f8b0021 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:06.635468 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-f128cc5c-0f60-484f-962a-b1d12f8b0021 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:06.643658 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-f128cc5c-0f60-484f-962a-b1d12f8b0021 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:06.645202 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-f128cc5c-0f60-484f-962a-b1d12f8b0021 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:06.646312 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-f128cc5c-0f60-484f-962a-b1d12f8b0021 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1408 microversion: 2.20 time: 0.151187 Jun 07 14:41:06.646868 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 132/249] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:41:06 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1408 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:41:07.295516 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-9efd21ee-9071-4cf0-b159-e400276981a0 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:41:07.296146 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-9efd21ee-9071-4cf0-b159-e400276981a0 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: ee2e782c-42ff-4093-9246-75d4e69929b3] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:41:07.303143 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-9efd21ee-9071-4cf0-b159-e400276981a0 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:07.303619 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-9efd21ee-9071-4cf0-b159-e400276981a0 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:07.304398 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-9efd21ee-9071-4cf0-b159-e400276981a0 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:07.304822 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-9efd21ee-9071-4cf0-b159-e400276981a0 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:07.430256 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-9efd21ee-9071-4cf0-b159-e400276981a0 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:07.437607 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-9efd21ee-9071-4cf0-b159-e400276981a0 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3" status: 200 len: 1519 microversion: 2.1 time: 0.145947 Jun 07 14:41:07.438152 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 118/250] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:41:07 2022] GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3 => generated 1519 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:41:07.663823 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-5156ea0d-3a7c-4496-bacb-714fac258655 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:41:07.664336 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-5156ea0d-3a7c-4496-bacb-714fac258655 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:41:07.670403 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5156ea0d-3a7c-4496-bacb-714fac258655 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:07.670841 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5156ea0d-3a7c-4496-bacb-714fac258655 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:07.671590 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5156ea0d-3a7c-4496-bacb-714fac258655 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:07.672022 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5156ea0d-3a7c-4496-bacb-714fac258655 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:07.805295 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-5156ea0d-3a7c-4496-bacb-714fac258655 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:07.808657 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG dbcounter [-] [118158] Writing DB stats nova_cell1:SELECT=100 {{(pid=118158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:41:07.813327 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-5156ea0d-3a7c-4496-bacb-714fac258655 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:07.814805 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-5156ea0d-3a7c-4496-bacb-714fac258655 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:07.816277 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-5156ea0d-3a7c-4496-bacb-714fac258655 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1408 microversion: 2.20 time: 0.156106 Jun 07 14:41:07.816453 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 133/251] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:41:07 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1408 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:41:08.454470 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-58bcebd2-7855-4696-9632-2f56f4a43a71 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:41:08.455084 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-58bcebd2-7855-4696-9632-2f56f4a43a71 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: ee2e782c-42ff-4093-9246-75d4e69929b3] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:41:08.462314 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-58bcebd2-7855-4696-9632-2f56f4a43a71 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:08.462760 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-58bcebd2-7855-4696-9632-2f56f4a43a71 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:08.463522 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-58bcebd2-7855-4696-9632-2f56f4a43a71 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:08.463954 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-58bcebd2-7855-4696-9632-2f56f4a43a71 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:08.596064 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-58bcebd2-7855-4696-9632-2f56f4a43a71 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:08.603602 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-58bcebd2-7855-4696-9632-2f56f4a43a71 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3" status: 200 len: 1519 microversion: 2.1 time: 0.152885 Jun 07 14:41:08.604155 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 119/252] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:41:08 2022] GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3 => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:41:08.833914 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-d4704ab2-4b55-4f9c-abc8-bc2e1a7f6e34 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:41:08.834525 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-d4704ab2-4b55-4f9c-abc8-bc2e1a7f6e34 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:41:08.840860 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-d4704ab2-4b55-4f9c-abc8-bc2e1a7f6e34 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:08.841307 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-d4704ab2-4b55-4f9c-abc8-bc2e1a7f6e34 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:08.842065 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-d4704ab2-4b55-4f9c-abc8-bc2e1a7f6e34 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:08.842501 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-d4704ab2-4b55-4f9c-abc8-bc2e1a7f6e34 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:08.968647 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-d4704ab2-4b55-4f9c-abc8-bc2e1a7f6e34 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:08.976765 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-d4704ab2-4b55-4f9c-abc8-bc2e1a7f6e34 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:08.978247 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-d4704ab2-4b55-4f9c-abc8-bc2e1a7f6e34 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:08.979344 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-d4704ab2-4b55-4f9c-abc8-bc2e1a7f6e34 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1408 microversion: 2.20 time: 0.149376 Jun 07 14:41:08.979886 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 134/253] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:41:08 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1408 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:41:09.619983 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-991a8436-7d15-4b8f-9ec8-c801718def0a tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:41:09.620628 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-991a8436-7d15-4b8f-9ec8-c801718def0a tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: ee2e782c-42ff-4093-9246-75d4e69929b3] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:41:09.622682 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG dbcounter [-] [118157] Writing DB stats nova_cell0:SELECT=2 {{(pid=118157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:41:09.623391 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG dbcounter [-] [118157] Writing DB stats nova_cell0:SELECT=6 {{(pid=118157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:41:09.629007 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-991a8436-7d15-4b8f-9ec8-c801718def0a tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:09.629456 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-991a8436-7d15-4b8f-9ec8-c801718def0a tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:09.630320 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-991a8436-7d15-4b8f-9ec8-c801718def0a tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:09.630758 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-991a8436-7d15-4b8f-9ec8-c801718def0a tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:09.634778 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG dbcounter [-] [118157] Writing DB stats nova_cell1:SELECT=100 {{(pid=118157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:41:09.758530 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-991a8436-7d15-4b8f-9ec8-c801718def0a tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:09.766104 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-991a8436-7d15-4b8f-9ec8-c801718def0a tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3" status: 200 len: 1519 microversion: 2.1 time: 0.150182 Jun 07 14:41:09.766881 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 120/254] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:41:09 2022] GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3 => generated 1519 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:41:09.998025 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-78c7a7c1-274b-4ad0-8c78-e6b350266312 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:41:09.998633 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-78c7a7c1-274b-4ad0-8c78-e6b350266312 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:41:10.000498 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG dbcounter [-] [118158] Writing DB stats nova_cell0:SELECT=6 {{(pid=118158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:41:10.005289 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-78c7a7c1-274b-4ad0-8c78-e6b350266312 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:10.005732 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-78c7a7c1-274b-4ad0-8c78-e6b350266312 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:10.006489 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-78c7a7c1-274b-4ad0-8c78-e6b350266312 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:10.006975 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-78c7a7c1-274b-4ad0-8c78-e6b350266312 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:10.136505 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-78c7a7c1-274b-4ad0-8c78-e6b350266312 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:10.145588 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-78c7a7c1-274b-4ad0-8c78-e6b350266312 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:10.147097 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-78c7a7c1-274b-4ad0-8c78-e6b350266312 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:10.148220 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-78c7a7c1-274b-4ad0-8c78-e6b350266312 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1408 microversion: 2.20 time: 0.154034 Jun 07 14:41:10.149142 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 135/255] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:41:09 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1408 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:41:10.783231 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-dae4bcba-fefd-4c2b-9ba8-0152575b3fa1 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:41:10.784394 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-dae4bcba-fefd-4c2b-9ba8-0152575b3fa1 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: ee2e782c-42ff-4093-9246-75d4e69929b3] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:41:10.786838 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG dbcounter [-] [118157] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=118157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:41:10.792096 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-dae4bcba-fefd-4c2b-9ba8-0152575b3fa1 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:10.792568 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-dae4bcba-fefd-4c2b-9ba8-0152575b3fa1 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:10.793314 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-dae4bcba-fefd-4c2b-9ba8-0152575b3fa1 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:10.793737 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-dae4bcba-fefd-4c2b-9ba8-0152575b3fa1 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:10.929109 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-dae4bcba-fefd-4c2b-9ba8-0152575b3fa1 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:10.936597 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-dae4bcba-fefd-4c2b-9ba8-0152575b3fa1 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3" status: 200 len: 1519 microversion: 2.1 time: 0.157528 Jun 07 14:41:10.937823 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 121/256] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:41:10 2022] GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:41:11.166046 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-8d7402e0-870a-41b5-b6cc-09bc6d3d98b2 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:41:11.166739 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-8d7402e0-870a-41b5-b6cc-09bc6d3d98b2 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:41:11.172707 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-8d7402e0-870a-41b5-b6cc-09bc6d3d98b2 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:11.173156 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-8d7402e0-870a-41b5-b6cc-09bc6d3d98b2 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:11.173912 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-8d7402e0-870a-41b5-b6cc-09bc6d3d98b2 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:11.174371 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-8d7402e0-870a-41b5-b6cc-09bc6d3d98b2 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:11.314589 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-8d7402e0-870a-41b5-b6cc-09bc6d3d98b2 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:11.322410 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-8d7402e0-870a-41b5-b6cc-09bc6d3d98b2 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:11.323895 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-8d7402e0-870a-41b5-b6cc-09bc6d3d98b2 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:11.325025 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-8d7402e0-870a-41b5-b6cc-09bc6d3d98b2 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1408 microversion: 2.20 time: 0.162925 Jun 07 14:41:11.325567 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 136/257] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:41:11 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1408 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:41:11.953368 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-f81d5b03-6380-470f-9898-f3d2649fb114 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:41:11.953960 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-f81d5b03-6380-470f-9898-f3d2649fb114 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: ee2e782c-42ff-4093-9246-75d4e69929b3] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:41:11.961455 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-f81d5b03-6380-470f-9898-f3d2649fb114 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:11.962388 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-f81d5b03-6380-470f-9898-f3d2649fb114 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:11.962651 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-f81d5b03-6380-470f-9898-f3d2649fb114 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:11.963084 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-f81d5b03-6380-470f-9898-f3d2649fb114 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:12.090435 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-f81d5b03-6380-470f-9898-f3d2649fb114 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:12.098483 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-f81d5b03-6380-470f-9898-f3d2649fb114 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3" status: 200 len: 1519 microversion: 2.1 time: 0.148998 Jun 07 14:41:12.099046 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 122/258] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:41:11 2022] GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3 => generated 1519 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:41:12.342972 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-5dbf24d4-a795-454b-977b-a078ae8bd9b8 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:41:12.343737 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-5dbf24d4-a795-454b-977b-a078ae8bd9b8 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:41:12.349944 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5dbf24d4-a795-454b-977b-a078ae8bd9b8 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:12.350400 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5dbf24d4-a795-454b-977b-a078ae8bd9b8 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:12.351171 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5dbf24d4-a795-454b-977b-a078ae8bd9b8 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:12.351615 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5dbf24d4-a795-454b-977b-a078ae8bd9b8 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:12.478407 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-5dbf24d4-a795-454b-977b-a078ae8bd9b8 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:12.486344 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-5dbf24d4-a795-454b-977b-a078ae8bd9b8 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:12.488398 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-5dbf24d4-a795-454b-977b-a078ae8bd9b8 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:12.489622 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-5dbf24d4-a795-454b-977b-a078ae8bd9b8 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1408 microversion: 2.20 time: 0.150548 Jun 07 14:41:12.490173 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 137/259] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:41:12 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1408 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:41:13.115095 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-2d53467d-a835-4384-b315-614a2af5819e tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:41:13.115793 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-2d53467d-a835-4384-b315-614a2af5819e tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: ee2e782c-42ff-4093-9246-75d4e69929b3] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:41:13.122705 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-2d53467d-a835-4384-b315-614a2af5819e tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:13.123154 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-2d53467d-a835-4384-b315-614a2af5819e tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:13.123915 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-2d53467d-a835-4384-b315-614a2af5819e tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:13.124356 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-2d53467d-a835-4384-b315-614a2af5819e tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:13.254400 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-2d53467d-a835-4384-b315-614a2af5819e tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:13.262035 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-2d53467d-a835-4384-b315-614a2af5819e tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3" status: 200 len: 1519 microversion: 2.1 time: 0.150977 Jun 07 14:41:13.262596 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 123/260] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:41:13 2022] GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3 => generated 1519 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:41:13.509598 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-6468ba7d-dcea-4ec8-808b-b03750838c4c tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:41:13.510135 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-6468ba7d-dcea-4ec8-808b-b03750838c4c tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:41:13.516359 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-6468ba7d-dcea-4ec8-808b-b03750838c4c tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:13.516847 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-6468ba7d-dcea-4ec8-808b-b03750838c4c tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:13.517601 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-6468ba7d-dcea-4ec8-808b-b03750838c4c tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:13.518035 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-6468ba7d-dcea-4ec8-808b-b03750838c4c tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:13.667916 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-6468ba7d-dcea-4ec8-808b-b03750838c4c tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:13.679547 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-6468ba7d-dcea-4ec8-808b-b03750838c4c tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:13.683750 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-6468ba7d-dcea-4ec8-808b-b03750838c4c tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:13.683750 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-6468ba7d-dcea-4ec8-808b-b03750838c4c tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1408 microversion: 2.20 time: 0.176571 Jun 07 14:41:13.683750 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 138/261] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:41:13 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1408 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:41:14.283195 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-071d4bc0-375c-420b-9554-912685ebafd4 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:41:14.284580 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-071d4bc0-375c-420b-9554-912685ebafd4 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: ee2e782c-42ff-4093-9246-75d4e69929b3] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:41:14.291500 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-071d4bc0-375c-420b-9554-912685ebafd4 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:14.291943 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-071d4bc0-375c-420b-9554-912685ebafd4 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:14.292740 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-071d4bc0-375c-420b-9554-912685ebafd4 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:14.293169 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-071d4bc0-375c-420b-9554-912685ebafd4 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:14.444169 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-071d4bc0-375c-420b-9554-912685ebafd4 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:14.453700 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-071d4bc0-375c-420b-9554-912685ebafd4 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3" status: 200 len: 1519 microversion: 2.1 time: 0.172433 Jun 07 14:41:14.453700 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 124/262] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:41:14 2022] GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3 => generated 1519 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:41:14.701575 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-d623531e-d4b4-451c-a2a1-fcf66dfd5210 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:41:14.702204 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-d623531e-d4b4-451c-a2a1-fcf66dfd5210 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:41:14.711272 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-d623531e-d4b4-451c-a2a1-fcf66dfd5210 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:14.711778 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-d623531e-d4b4-451c-a2a1-fcf66dfd5210 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:14.712971 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-d623531e-d4b4-451c-a2a1-fcf66dfd5210 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:14.713572 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-d623531e-d4b4-451c-a2a1-fcf66dfd5210 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:14.882976 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [req-7e10a71e-9513-43ea-9f9b-4baef2d6ed5a req-1d8466b9-e3da-4c16-a21a-899cce68ec97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8a8352c-4f05-4640-a976-edb025819089", "tag": "557a43fa-c7ca-47d0-9a4b-fe35626e8941"}]} {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:41:14.891835 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [req-7e10a71e-9513-43ea-9f9b-4baef2d6ed5a req-1d8466b9-e3da-4c16-a21a-899cce68ec97 service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:14.892280 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [req-7e10a71e-9513-43ea-9f9b-4baef2d6ed5a req-1d8466b9-e3da-4c16-a21a-899cce68ec97 service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:14.904338 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.compute.server_external_events [req-7e10a71e-9513-43ea-9f9b-4baef2d6ed5a req-1d8466b9-e3da-4c16-a21a-899cce68ec97 service nova] Creating event network-changed:557a43fa-c7ca-47d0-9a4b-fe35626e8941 for instance a8a8352c-4f05-4640-a976-edb025819089 on hv-cinder-84497 Jun 07 14:41:14.913085 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [req-7e10a71e-9513-43ea-9f9b-4baef2d6ed5a req-1d8466b9-e3da-4c16-a21a-899cce68ec97 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030594 Jun 07 14:41:14.913085 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 125/263] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jun 7 14:41:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 14:41:15.173583 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-d623531e-d4b4-451c-a2a1-fcf66dfd5210 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:15.183890 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-d623531e-d4b4-451c-a2a1-fcf66dfd5210 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:15.186151 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-d623531e-d4b4-451c-a2a1-fcf66dfd5210 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:15.187397 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-d623531e-d4b4-451c-a2a1-fcf66dfd5210 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1408 microversion: 2.20 time: 0.489630 Jun 07 14:41:15.199461 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 139/264] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:41:14 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1408 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 14:41:15.471067 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-6c7c7c2b-bbc5-42fc-b74a-fe8c39c0b16b tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:41:15.471462 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-6c7c7c2b-bbc5-42fc-b74a-fe8c39c0b16b tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: ee2e782c-42ff-4093-9246-75d4e69929b3] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:41:15.477882 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-6c7c7c2b-bbc5-42fc-b74a-fe8c39c0b16b tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:15.478714 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-6c7c7c2b-bbc5-42fc-b74a-fe8c39c0b16b tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:15.479132 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-6c7c7c2b-bbc5-42fc-b74a-fe8c39c0b16b tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:15.479568 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-6c7c7c2b-bbc5-42fc-b74a-fe8c39c0b16b tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:15.655244 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-6c7c7c2b-bbc5-42fc-b74a-fe8c39c0b16b tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:15.671689 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-6c7c7c2b-bbc5-42fc-b74a-fe8c39c0b16b tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3" status: 200 len: 1519 microversion: 2.1 time: 0.206066 Jun 07 14:41:15.672263 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 126/265] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:41:15 2022] GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3 => generated 1519 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:41:16.206998 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-3943ba64-634c-4f0b-8e3b-2e3d0036180d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:41:16.207672 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-3943ba64-634c-4f0b-8e3b-2e3d0036180d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:41:16.214075 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-3943ba64-634c-4f0b-8e3b-2e3d0036180d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:16.214527 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-3943ba64-634c-4f0b-8e3b-2e3d0036180d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:16.215458 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-3943ba64-634c-4f0b-8e3b-2e3d0036180d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:16.216068 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-3943ba64-634c-4f0b-8e3b-2e3d0036180d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:16.348333 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-3943ba64-634c-4f0b-8e3b-2e3d0036180d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:16.356829 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-3943ba64-634c-4f0b-8e3b-2e3d0036180d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:16.358331 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-3943ba64-634c-4f0b-8e3b-2e3d0036180d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:16.359448 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-3943ba64-634c-4f0b-8e3b-2e3d0036180d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1408 microversion: 2.20 time: 0.157086 Jun 07 14:41:16.370741 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 140/266] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:41:16 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1408 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:41:16.689068 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-735c5327-1868-4181-887b-6232b95fc452 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:41:16.689887 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-735c5327-1868-4181-887b-6232b95fc452 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: ee2e782c-42ff-4093-9246-75d4e69929b3] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:41:16.696807 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-735c5327-1868-4181-887b-6232b95fc452 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:16.697254 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-735c5327-1868-4181-887b-6232b95fc452 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:16.698026 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-735c5327-1868-4181-887b-6232b95fc452 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:16.698468 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-735c5327-1868-4181-887b-6232b95fc452 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:16.888776 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-735c5327-1868-4181-887b-6232b95fc452 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:16.903274 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-735c5327-1868-4181-887b-6232b95fc452 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3" status: 200 len: 1499 microversion: 2.1 time: 0.218007 Jun 07 14:41:16.904119 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 127/267] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:41:16 2022] GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3 => generated 1499 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:41:16.927739 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-d9efbae9-af60-4554-89aa-1f0ff233b323 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:41:16.928356 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-d9efbae9-af60-4554-89aa-1f0ff233b323 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 45f65f98-e1ca-4e07-872a-ef0403e2d50a] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:41:16.936756 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-d9efbae9-af60-4554-89aa-1f0ff233b323 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:16.937217 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-d9efbae9-af60-4554-89aa-1f0ff233b323 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:16.938063 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-d9efbae9-af60-4554-89aa-1f0ff233b323 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:16.938508 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-d9efbae9-af60-4554-89aa-1f0ff233b323 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:17.103704 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-d9efbae9-af60-4554-89aa-1f0ff233b323 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:17.111803 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-d9efbae9-af60-4554-89aa-1f0ff233b323 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/45f65f98-e1ca-4e07-872a-ef0403e2d50a" status: 200 len: 1516 microversion: 2.1 time: 0.188384 Jun 07 14:41:17.112606 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 141/268] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:41:16 2022] GET /compute/v2.1/servers/45f65f98-e1ca-4e07-872a-ef0403e2d50a => generated 1516 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:41:17.379342 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-2a504242-871e-4eec-882c-7ebd4544a7ec tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:41:17.379342 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-2a504242-871e-4eec-882c-7ebd4544a7ec tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:41:17.387636 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-2a504242-871e-4eec-882c-7ebd4544a7ec tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:17.388481 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-2a504242-871e-4eec-882c-7ebd4544a7ec tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:17.389787 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-2a504242-871e-4eec-882c-7ebd4544a7ec tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:17.390023 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-2a504242-871e-4eec-882c-7ebd4544a7ec tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:17.559033 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-2a504242-871e-4eec-882c-7ebd4544a7ec tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:17.567934 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-2a504242-871e-4eec-882c-7ebd4544a7ec tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:17.569605 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-2a504242-871e-4eec-882c-7ebd4544a7ec tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:17.570746 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-2a504242-871e-4eec-882c-7ebd4544a7ec tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1408 microversion: 2.20 time: 0.196764 Jun 07 14:41:17.571321 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 128/269] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:41:17 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1408 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:41:18.594864 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-d03aadcb-7434-4fab-83aa-2020913ebc6a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:41:18.595522 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-d03aadcb-7434-4fab-83aa-2020913ebc6a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:41:18.602441 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-d03aadcb-7434-4fab-83aa-2020913ebc6a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:18.602897 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-d03aadcb-7434-4fab-83aa-2020913ebc6a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:18.603675 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-d03aadcb-7434-4fab-83aa-2020913ebc6a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:18.604117 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-d03aadcb-7434-4fab-83aa-2020913ebc6a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:18.767615 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-d03aadcb-7434-4fab-83aa-2020913ebc6a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:18.777724 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-d03aadcb-7434-4fab-83aa-2020913ebc6a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:18.779791 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-d03aadcb-7434-4fab-83aa-2020913ebc6a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:18.781123 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-d03aadcb-7434-4fab-83aa-2020913ebc6a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1408 microversion: 2.20 time: 0.190610 Jun 07 14:41:18.782333 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 142/270] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:41:18 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1408 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:41:19.800265 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-74d2318e-702b-4a35-8056-a6d2758a0a2d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:41:19.800906 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-74d2318e-702b-4a35-8056-a6d2758a0a2d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:41:19.812982 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-74d2318e-702b-4a35-8056-a6d2758a0a2d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:19.812982 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-74d2318e-702b-4a35-8056-a6d2758a0a2d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:19.812982 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-74d2318e-702b-4a35-8056-a6d2758a0a2d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:19.812982 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-74d2318e-702b-4a35-8056-a6d2758a0a2d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:19.939173 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-74d2318e-702b-4a35-8056-a6d2758a0a2d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:19.947851 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-74d2318e-702b-4a35-8056-a6d2758a0a2d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:19.949325 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-74d2318e-702b-4a35-8056-a6d2758a0a2d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:19.950417 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-74d2318e-702b-4a35-8056-a6d2758a0a2d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1408 microversion: 2.20 time: 0.154084 Jun 07 14:41:19.950969 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 129/271] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:41:19 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1408 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:41:20.198194 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-5e11e109-c708-43ea-8101-293d651f1b54 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:41:20.199192 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-5e11e109-c708-43ea-8101-293d651f1b54 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 45f65f98-e1ca-4e07-872a-ef0403e2d50a] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:41:20.205953 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5e11e109-c708-43ea-8101-293d651f1b54 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:20.206759 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5e11e109-c708-43ea-8101-293d651f1b54 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:20.207787 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5e11e109-c708-43ea-8101-293d651f1b54 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:20.208240 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5e11e109-c708-43ea-8101-293d651f1b54 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:20.232300 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.objects.instance [None req-5e11e109-c708-43ea-8101-293d651f1b54 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lazy-loading 'flavor' on Instance uuid 45f65f98-e1ca-4e07-872a-ef0403e2d50a {{(pid=118158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 14:41:20.499063 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-5e11e109-c708-43ea-8101-293d651f1b54 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "POST /compute/v2.1/servers/45f65f98-e1ca-4e07-872a-ef0403e2d50a/action" status: 200 len: 32 microversion: 2.1 time: 0.304857 Jun 07 14:41:20.499671 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 143/272] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Jun 7 14:41:20 2022] POST /compute/v2.1/servers/45f65f98-e1ca-4e07-872a-ef0403e2d50a/action => generated 32 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 07 14:41:20.509586 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-ecdf159a-05f6-46e8-a200-42fbbac4f353 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:41:20.510206 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-ecdf159a-05f6-46e8-a200-42fbbac4f353 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 45f65f98-e1ca-4e07-872a-ef0403e2d50a] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:41:20.516714 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-ecdf159a-05f6-46e8-a200-42fbbac4f353 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:20.517161 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-ecdf159a-05f6-46e8-a200-42fbbac4f353 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:20.518123 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-ecdf159a-05f6-46e8-a200-42fbbac4f353 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:20.518573 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-ecdf159a-05f6-46e8-a200-42fbbac4f353 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:20.674868 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-ecdf159a-05f6-46e8-a200-42fbbac4f353 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:20.690132 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-ecdf159a-05f6-46e8-a200-42fbbac4f353 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/45f65f98-e1ca-4e07-872a-ef0403e2d50a" status: 200 len: 1522 microversion: 2.1 time: 0.184350 Jun 07 14:41:20.690773 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 130/273] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:41:20 2022] GET /compute/v2.1/servers/45f65f98-e1ca-4e07-872a-ef0403e2d50a => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:41:20.973412 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-35fc9287-241a-49e3-9b82-d2d894d7e806 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:41:20.973412 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-35fc9287-241a-49e3-9b82-d2d894d7e806 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:41:20.982875 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-35fc9287-241a-49e3-9b82-d2d894d7e806 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:20.983589 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-35fc9287-241a-49e3-9b82-d2d894d7e806 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:20.984755 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-35fc9287-241a-49e3-9b82-d2d894d7e806 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:20.985210 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-35fc9287-241a-49e3-9b82-d2d894d7e806 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:21.249732 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-35fc9287-241a-49e3-9b82-d2d894d7e806 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:21.258209 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-35fc9287-241a-49e3-9b82-d2d894d7e806 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:21.259738 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-35fc9287-241a-49e3-9b82-d2d894d7e806 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:21.260882 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-35fc9287-241a-49e3-9b82-d2d894d7e806 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1408 microversion: 2.20 time: 0.294877 Jun 07 14:41:21.261627 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 144/274] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:41:20 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1408 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:41:21.712699 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-e2648d41-2bdb-4c08-97bd-404ea2b06842 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:41:21.714521 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-e2648d41-2bdb-4c08-97bd-404ea2b06842 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 45f65f98-e1ca-4e07-872a-ef0403e2d50a] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:41:21.721984 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-e2648d41-2bdb-4c08-97bd-404ea2b06842 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:21.722775 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-e2648d41-2bdb-4c08-97bd-404ea2b06842 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:21.723914 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-e2648d41-2bdb-4c08-97bd-404ea2b06842 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:21.724287 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-e2648d41-2bdb-4c08-97bd-404ea2b06842 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:21.867546 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-e2648d41-2bdb-4c08-97bd-404ea2b06842 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:21.875363 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-e2648d41-2bdb-4c08-97bd-404ea2b06842 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/45f65f98-e1ca-4e07-872a-ef0403e2d50a" status: 200 len: 1522 microversion: 2.1 time: 0.167638 Jun 07 14:41:21.875907 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 131/275] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:41:21 2022] GET /compute/v2.1/servers/45f65f98-e1ca-4e07-872a-ef0403e2d50a => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:41:22.280515 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-39c47e17-e768-4faf-b3e1-e225e6bb1064 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:41:22.281100 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-39c47e17-e768-4faf-b3e1-e225e6bb1064 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:41:22.287566 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-39c47e17-e768-4faf-b3e1-e225e6bb1064 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:22.288018 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-39c47e17-e768-4faf-b3e1-e225e6bb1064 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:22.288839 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-39c47e17-e768-4faf-b3e1-e225e6bb1064 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:22.289284 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-39c47e17-e768-4faf-b3e1-e225e6bb1064 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:22.437649 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-39c47e17-e768-4faf-b3e1-e225e6bb1064 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:22.446354 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-39c47e17-e768-4faf-b3e1-e225e6bb1064 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:22.447797 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-39c47e17-e768-4faf-b3e1-e225e6bb1064 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:22.449264 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-39c47e17-e768-4faf-b3e1-e225e6bb1064 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1408 microversion: 2.20 time: 0.172698 Jun 07 14:41:22.449865 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 145/276] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:41:22 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1408 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:41:22.897046 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-b2e5c42a-1d6f-477c-8881-ca07ef1b6158 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:41:22.897046 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-b2e5c42a-1d6f-477c-8881-ca07ef1b6158 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 45f65f98-e1ca-4e07-872a-ef0403e2d50a] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:41:22.899610 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-b2e5c42a-1d6f-477c-8881-ca07ef1b6158 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:22.900061 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-b2e5c42a-1d6f-477c-8881-ca07ef1b6158 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:22.900868 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-b2e5c42a-1d6f-477c-8881-ca07ef1b6158 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:22.901313 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-b2e5c42a-1d6f-477c-8881-ca07ef1b6158 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:23.064097 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-b2e5c42a-1d6f-477c-8881-ca07ef1b6158 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:23.077173 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-b2e5c42a-1d6f-477c-8881-ca07ef1b6158 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/45f65f98-e1ca-4e07-872a-ef0403e2d50a" status: 200 len: 1522 microversion: 2.1 time: 0.189010 Jun 07 14:41:23.085935 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 132/277] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:41:22 2022] GET /compute/v2.1/servers/45f65f98-e1ca-4e07-872a-ef0403e2d50a => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:41:23.470201 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-7ec07bc3-1572-4ac1-9db0-245c039d4f09 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:41:23.472246 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-7ec07bc3-1572-4ac1-9db0-245c039d4f09 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:41:23.482931 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-7ec07bc3-1572-4ac1-9db0-245c039d4f09 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:23.485961 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-7ec07bc3-1572-4ac1-9db0-245c039d4f09 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:23.487570 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-7ec07bc3-1572-4ac1-9db0-245c039d4f09 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:23.491306 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-7ec07bc3-1572-4ac1-9db0-245c039d4f09 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:23.695600 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-7ec07bc3-1572-4ac1-9db0-245c039d4f09 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:23.709417 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-7ec07bc3-1572-4ac1-9db0-245c039d4f09 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:23.710231 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-7ec07bc3-1572-4ac1-9db0-245c039d4f09 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:23.711399 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-7ec07bc3-1572-4ac1-9db0-245c039d4f09 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1408 microversion: 2.20 time: 0.246661 Jun 07 14:41:23.712421 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 146/278] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:41:23 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1408 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:41:24.095190 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-297722fe-d2b9-4419-a9d2-fc2d5cf20939 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:41:24.101840 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-297722fe-d2b9-4419-a9d2-fc2d5cf20939 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 45f65f98-e1ca-4e07-872a-ef0403e2d50a] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:41:24.103166 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-297722fe-d2b9-4419-a9d2-fc2d5cf20939 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:24.103803 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-297722fe-d2b9-4419-a9d2-fc2d5cf20939 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:24.104465 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-297722fe-d2b9-4419-a9d2-fc2d5cf20939 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:24.104859 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-297722fe-d2b9-4419-a9d2-fc2d5cf20939 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:24.341239 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-297722fe-d2b9-4419-a9d2-fc2d5cf20939 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:24.350309 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-297722fe-d2b9-4419-a9d2-fc2d5cf20939 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/45f65f98-e1ca-4e07-872a-ef0403e2d50a" status: 200 len: 1522 microversion: 2.1 time: 0.259283 Jun 07 14:41:24.354297 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 133/279] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:41:24 2022] GET /compute/v2.1/servers/45f65f98-e1ca-4e07-872a-ef0403e2d50a => generated 1522 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:41:24.731357 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-3b006d42-ee44-46cb-b1d2-f7eb1d60da5e tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:41:24.738043 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-3b006d42-ee44-46cb-b1d2-f7eb1d60da5e tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:41:24.739694 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-3b006d42-ee44-46cb-b1d2-f7eb1d60da5e tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:24.740243 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-3b006d42-ee44-46cb-b1d2-f7eb1d60da5e tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:24.741078 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-3b006d42-ee44-46cb-b1d2-f7eb1d60da5e tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:24.741621 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-3b006d42-ee44-46cb-b1d2-f7eb1d60da5e tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:24.897005 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-3b006d42-ee44-46cb-b1d2-f7eb1d60da5e tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:24.909924 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-3b006d42-ee44-46cb-b1d2-f7eb1d60da5e tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:24.911761 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-3b006d42-ee44-46cb-b1d2-f7eb1d60da5e tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:24.913158 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-3b006d42-ee44-46cb-b1d2-f7eb1d60da5e tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1408 microversion: 2.20 time: 0.185680 Jun 07 14:41:24.913913 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 147/280] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:41:24 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1408 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:41:25.372218 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-cdb9b79f-207f-4b99-97c1-94c75ab5b15e tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:41:25.373550 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-cdb9b79f-207f-4b99-97c1-94c75ab5b15e tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 45f65f98-e1ca-4e07-872a-ef0403e2d50a] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:41:25.385220 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-cdb9b79f-207f-4b99-97c1-94c75ab5b15e tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:25.385936 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-cdb9b79f-207f-4b99-97c1-94c75ab5b15e tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:25.387406 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-cdb9b79f-207f-4b99-97c1-94c75ab5b15e tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:25.388156 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-cdb9b79f-207f-4b99-97c1-94c75ab5b15e tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:25.561695 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-cdb9b79f-207f-4b99-97c1-94c75ab5b15e tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:25.570386 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-cdb9b79f-207f-4b99-97c1-94c75ab5b15e tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/45f65f98-e1ca-4e07-872a-ef0403e2d50a" status: 200 len: 1522 microversion: 2.1 time: 0.203083 Jun 07 14:41:25.571056 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 134/281] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:41:25 2022] GET /compute/v2.1/servers/45f65f98-e1ca-4e07-872a-ef0403e2d50a => generated 1522 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:41:25.935314 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-dd13d3f1-8cf9-4e17-9d8e-4b3ba7ba692d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:41:25.935788 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-dd13d3f1-8cf9-4e17-9d8e-4b3ba7ba692d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:41:25.942115 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-dd13d3f1-8cf9-4e17-9d8e-4b3ba7ba692d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:25.942570 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-dd13d3f1-8cf9-4e17-9d8e-4b3ba7ba692d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:25.943535 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-dd13d3f1-8cf9-4e17-9d8e-4b3ba7ba692d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:25.944238 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-dd13d3f1-8cf9-4e17-9d8e-4b3ba7ba692d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:25.986385 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG dbcounter [-] [118158] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:41:26.109329 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-dd13d3f1-8cf9-4e17-9d8e-4b3ba7ba692d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:26.117586 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-dd13d3f1-8cf9-4e17-9d8e-4b3ba7ba692d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:26.119137 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-dd13d3f1-8cf9-4e17-9d8e-4b3ba7ba692d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:26.120253 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-dd13d3f1-8cf9-4e17-9d8e-4b3ba7ba692d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1408 microversion: 2.20 time: 0.191832 Jun 07 14:41:26.121196 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 148/282] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:41:25 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1408 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:41:26.580228 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [req-0ff8a504-7804-4c31-a840-92ac00bd7458 req-06197813-1858-450a-af43-56a04e0cb416 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8a8352c-4f05-4640-a976-edb025819089", "name": "network-vif-plugged", "status": "completed", "tag": "557a43fa-c7ca-47d0-9a4b-fe35626e8941"}]} {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:41:26.590026 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-6c2321d1-d93f-4be9-8778-c429e4c14ce1 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:41:26.590907 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [req-0ff8a504-7804-4c31-a840-92ac00bd7458 req-06197813-1858-450a-af43-56a04e0cb416 service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:26.591075 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-6c2321d1-d93f-4be9-8778-c429e4c14ce1 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 45f65f98-e1ca-4e07-872a-ef0403e2d50a] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:41:26.591355 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [req-0ff8a504-7804-4c31-a840-92ac00bd7458 req-06197813-1858-450a-af43-56a04e0cb416 service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:26.599201 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG dbcounter [-] [118158] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=1 {{(pid=118158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:41:26.601435 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-6c2321d1-d93f-4be9-8778-c429e4c14ce1 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:26.602084 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-6c2321d1-d93f-4be9-8778-c429e4c14ce1 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:26.603030 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-6c2321d1-d93f-4be9-8778-c429e4c14ce1 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:26.603468 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-6c2321d1-d93f-4be9-8778-c429e4c14ce1 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:26.607139 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.compute.server_external_events [req-0ff8a504-7804-4c31-a840-92ac00bd7458 req-06197813-1858-450a-af43-56a04e0cb416 service nova] Creating event network-vif-plugged:557a43fa-c7ca-47d0-9a4b-fe35626e8941 for instance a8a8352c-4f05-4640-a976-edb025819089 on hv-cinder-84497 Jun 07 14:41:26.612467 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [req-0ff8a504-7804-4c31-a840-92ac00bd7458 req-06197813-1858-450a-af43-56a04e0cb416 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036427 Jun 07 14:41:26.613471 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 135/283] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jun 7 14:41:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:41:26.748603 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-6c2321d1-d93f-4be9-8778-c429e4c14ce1 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:26.756918 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-6c2321d1-d93f-4be9-8778-c429e4c14ce1 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/45f65f98-e1ca-4e07-872a-ef0403e2d50a" status: 200 len: 1522 microversion: 2.1 time: 0.170720 Jun 07 14:41:26.757473 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 149/284] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:41:26 2022] GET /compute/v2.1/servers/45f65f98-e1ca-4e07-872a-ef0403e2d50a => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:41:27.146760 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-99a4edd9-a620-474e-8bbd-8d189c1ba72f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:41:27.147463 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-99a4edd9-a620-474e-8bbd-8d189c1ba72f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:41:27.153732 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-99a4edd9-a620-474e-8bbd-8d189c1ba72f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:27.154177 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-99a4edd9-a620-474e-8bbd-8d189c1ba72f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:27.154937 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-99a4edd9-a620-474e-8bbd-8d189c1ba72f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:27.155373 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-99a4edd9-a620-474e-8bbd-8d189c1ba72f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:27.291245 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-99a4edd9-a620-474e-8bbd-8d189c1ba72f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:27.299283 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-99a4edd9-a620-474e-8bbd-8d189c1ba72f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:27.300839 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-99a4edd9-a620-474e-8bbd-8d189c1ba72f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:27.301947 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-99a4edd9-a620-474e-8bbd-8d189c1ba72f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1408 microversion: 2.20 time: 0.160084 Jun 07 14:41:27.302506 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 136/285] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:41:27 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1408 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:41:27.775596 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-e79bcfa0-ef1c-4bb0-abb1-ed04d67b1375 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:41:27.776204 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-e79bcfa0-ef1c-4bb0-abb1-ed04d67b1375 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 45f65f98-e1ca-4e07-872a-ef0403e2d50a] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:41:27.783120 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-e79bcfa0-ef1c-4bb0-abb1-ed04d67b1375 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:27.783565 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-e79bcfa0-ef1c-4bb0-abb1-ed04d67b1375 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:27.784948 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-e79bcfa0-ef1c-4bb0-abb1-ed04d67b1375 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:27.785383 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-e79bcfa0-ef1c-4bb0-abb1-ed04d67b1375 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:27.915150 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-e79bcfa0-ef1c-4bb0-abb1-ed04d67b1375 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:27.923149 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-e79bcfa0-ef1c-4bb0-abb1-ed04d67b1375 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/45f65f98-e1ca-4e07-872a-ef0403e2d50a" status: 200 len: 1522 microversion: 2.1 time: 0.152108 Jun 07 14:41:27.923715 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 150/286] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:41:27 2022] GET /compute/v2.1/servers/45f65f98-e1ca-4e07-872a-ef0403e2d50a => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:41:28.321688 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-1cb9b73e-4bdc-4c45-b22e-371366abcb9c tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:41:28.322390 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-1cb9b73e-4bdc-4c45-b22e-371366abcb9c tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:41:28.328720 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-1cb9b73e-4bdc-4c45-b22e-371366abcb9c tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:28.329159 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-1cb9b73e-4bdc-4c45-b22e-371366abcb9c tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:28.329924 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-1cb9b73e-4bdc-4c45-b22e-371366abcb9c tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:28.330347 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-1cb9b73e-4bdc-4c45-b22e-371366abcb9c tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:28.473085 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-1cb9b73e-4bdc-4c45-b22e-371366abcb9c tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:28.481610 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-1cb9b73e-4bdc-4c45-b22e-371366abcb9c tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:28.483357 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-1cb9b73e-4bdc-4c45-b22e-371366abcb9c tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:28.484493 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-1cb9b73e-4bdc-4c45-b22e-371366abcb9c tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1408 microversion: 2.20 time: 0.167159 Jun 07 14:41:28.485046 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 137/287] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:41:28 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1408 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:41:28.941860 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-7e4287ee-2441-479c-9708-dfc62baae19e tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:41:28.942483 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-7e4287ee-2441-479c-9708-dfc62baae19e tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 45f65f98-e1ca-4e07-872a-ef0403e2d50a] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:41:28.948691 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-7e4287ee-2441-479c-9708-dfc62baae19e tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:28.949381 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-7e4287ee-2441-479c-9708-dfc62baae19e tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:28.950161 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-7e4287ee-2441-479c-9708-dfc62baae19e tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:28.950599 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-7e4287ee-2441-479c-9708-dfc62baae19e tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:29.114079 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-7e4287ee-2441-479c-9708-dfc62baae19e tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:29.123833 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-7e4287ee-2441-479c-9708-dfc62baae19e tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/45f65f98-e1ca-4e07-872a-ef0403e2d50a" status: 200 len: 1522 microversion: 2.1 time: 0.186975 Jun 07 14:41:29.124426 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 151/288] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:41:28 2022] GET /compute/v2.1/servers/45f65f98-e1ca-4e07-872a-ef0403e2d50a => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:41:29.503082 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-1f20af81-c42e-428f-b608-1ee6984c1581 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:41:29.504795 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-1f20af81-c42e-428f-b608-1ee6984c1581 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:41:29.512136 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-1f20af81-c42e-428f-b608-1ee6984c1581 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:29.512617 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-1f20af81-c42e-428f-b608-1ee6984c1581 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:29.513396 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-1f20af81-c42e-428f-b608-1ee6984c1581 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:29.513830 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-1f20af81-c42e-428f-b608-1ee6984c1581 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:29.516883 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG dbcounter [-] [118157] Writing DB stats nova_cell1:SELECT=100 {{(pid=118157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:41:29.660050 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-1f20af81-c42e-428f-b608-1ee6984c1581 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:29.670261 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-1f20af81-c42e-428f-b608-1ee6984c1581 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:29.671934 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-1f20af81-c42e-428f-b608-1ee6984c1581 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:29.675647 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-1f20af81-c42e-428f-b608-1ee6984c1581 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1600 microversion: 2.20 time: 0.173925 Jun 07 14:41:29.675647 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 138/289] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:41:29 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1600 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:41:29.691595 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-d4286133-832e-4d91-9386-d493d63b00a6 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:41:29.692089 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-d4286133-832e-4d91-9386-d493d63b00a6 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:41:29.698784 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-d4286133-832e-4d91-9386-d493d63b00a6 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:29.699443 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-d4286133-832e-4d91-9386-d493d63b00a6 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:29.700303 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-d4286133-832e-4d91-9386-d493d63b00a6 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:29.703792 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-d4286133-832e-4d91-9386-d493d63b00a6 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:29.790609 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-d4286133-832e-4d91-9386-d493d63b00a6 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.103524 Jun 07 14:41:29.791190 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 152/290] 10.222.0.85 () {60 vars in 1315 bytes} [Tue Jun 7 14:41:29 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089/os-interface => generated 284 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 14:41:30.141494 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-4203bfc3-ce17-45e9-8265-9f514ff35872 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:41:30.142411 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-4203bfc3-ce17-45e9-8265-9f514ff35872 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 45f65f98-e1ca-4e07-872a-ef0403e2d50a] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:41:30.149630 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-4203bfc3-ce17-45e9-8265-9f514ff35872 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:30.150074 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-4203bfc3-ce17-45e9-8265-9f514ff35872 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:30.151034 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-4203bfc3-ce17-45e9-8265-9f514ff35872 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:30.151643 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-4203bfc3-ce17-45e9-8265-9f514ff35872 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:30.665954 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-4203bfc3-ce17-45e9-8265-9f514ff35872 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:30.675011 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-4203bfc3-ce17-45e9-8265-9f514ff35872 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/45f65f98-e1ca-4e07-872a-ef0403e2d50a" status: 200 len: 1522 microversion: 2.1 time: 0.537446 Jun 07 14:41:30.675876 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 139/291] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:41:30 2022] GET /compute/v2.1/servers/45f65f98-e1ca-4e07-872a-ef0403e2d50a => generated 1522 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:41:31.212982 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [req-6c739282-ec60-430c-9767-e51f7854fd31 req-a8f1a1e4-f678-485d-9210-918f3558c23d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8a8352c-4f05-4640-a976-edb025819089", "tag": "557a43fa-c7ca-47d0-9a4b-fe35626e8941"}]} {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:41:31.222220 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [req-6c739282-ec60-430c-9767-e51f7854fd31 req-a8f1a1e4-f678-485d-9210-918f3558c23d service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:31.222714 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [req-6c739282-ec60-430c-9767-e51f7854fd31 req-a8f1a1e4-f678-485d-9210-918f3558c23d service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:31.238175 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.compute.server_external_events [req-6c739282-ec60-430c-9767-e51f7854fd31 req-a8f1a1e4-f678-485d-9210-918f3558c23d service nova] Creating event network-changed:557a43fa-c7ca-47d0-9a4b-fe35626e8941 for instance a8a8352c-4f05-4640-a976-edb025819089 on hv-cinder-84497 Jun 07 14:41:31.250033 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [req-6c739282-ec60-430c-9767-e51f7854fd31 req-a8f1a1e4-f678-485d-9210-918f3558c23d service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035171 Jun 07 14:41:31.257622 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 153/292] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jun 7 14:41:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 14:41:31.699445 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-3093c8f5-96b0-43dd-bf28-b3deb04a2cfc tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:41:31.700719 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-3093c8f5-96b0-43dd-bf28-b3deb04a2cfc tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 45f65f98-e1ca-4e07-872a-ef0403e2d50a] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:41:31.709095 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-3093c8f5-96b0-43dd-bf28-b3deb04a2cfc tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:31.709557 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-3093c8f5-96b0-43dd-bf28-b3deb04a2cfc tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:31.712756 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-3093c8f5-96b0-43dd-bf28-b3deb04a2cfc tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:31.713204 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-3093c8f5-96b0-43dd-bf28-b3deb04a2cfc tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:31.978876 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-3093c8f5-96b0-43dd-bf28-b3deb04a2cfc tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:31.994115 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-3093c8f5-96b0-43dd-bf28-b3deb04a2cfc tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/45f65f98-e1ca-4e07-872a-ef0403e2d50a" status: 200 len: 1522 microversion: 2.1 time: 0.298847 Jun 07 14:41:31.994695 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 140/293] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:41:31 2022] GET /compute/v2.1/servers/45f65f98-e1ca-4e07-872a-ef0403e2d50a => generated 1522 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:41:33.012635 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-d0a4b858-2446-4ea0-91af-686951e6f87c tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:41:33.013365 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-d0a4b858-2446-4ea0-91af-686951e6f87c tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 45f65f98-e1ca-4e07-872a-ef0403e2d50a] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:41:33.020164 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-d0a4b858-2446-4ea0-91af-686951e6f87c tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:33.020585 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-d0a4b858-2446-4ea0-91af-686951e6f87c tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:33.021354 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-d0a4b858-2446-4ea0-91af-686951e6f87c tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:33.021791 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-d0a4b858-2446-4ea0-91af-686951e6f87c tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:33.164288 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-d0a4b858-2446-4ea0-91af-686951e6f87c tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:33.172244 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-d0a4b858-2446-4ea0-91af-686951e6f87c tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/45f65f98-e1ca-4e07-872a-ef0403e2d50a" status: 200 len: 1522 microversion: 2.1 time: 0.164251 Jun 07 14:41:33.181707 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 154/294] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:41:33 2022] GET /compute/v2.1/servers/45f65f98-e1ca-4e07-872a-ef0403e2d50a => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:41:34.188641 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-8a573e63-6940-4c62-b608-534335aa217d tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:41:34.189392 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-8a573e63-6940-4c62-b608-534335aa217d tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 45f65f98-e1ca-4e07-872a-ef0403e2d50a] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:41:34.196557 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-8a573e63-6940-4c62-b608-534335aa217d tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:34.197009 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-8a573e63-6940-4c62-b608-534335aa217d tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:34.197772 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-8a573e63-6940-4c62-b608-534335aa217d tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:34.198208 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-8a573e63-6940-4c62-b608-534335aa217d tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:34.357703 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-8a573e63-6940-4c62-b608-534335aa217d tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:34.366157 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-8a573e63-6940-4c62-b608-534335aa217d tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/45f65f98-e1ca-4e07-872a-ef0403e2d50a" status: 200 len: 1522 microversion: 2.1 time: 0.181420 Jun 07 14:41:34.366823 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 141/295] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:41:34 2022] GET /compute/v2.1/servers/45f65f98-e1ca-4e07-872a-ef0403e2d50a => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:41:35.384654 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-7ad6820d-1e7d-469c-bb24-5c20106c04d9 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:41:35.385190 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-7ad6820d-1e7d-469c-bb24-5c20106c04d9 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 45f65f98-e1ca-4e07-872a-ef0403e2d50a] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:41:35.391516 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-7ad6820d-1e7d-469c-bb24-5c20106c04d9 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:35.391970 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-7ad6820d-1e7d-469c-bb24-5c20106c04d9 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:35.392761 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-7ad6820d-1e7d-469c-bb24-5c20106c04d9 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:35.393201 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-7ad6820d-1e7d-469c-bb24-5c20106c04d9 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:35.522123 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-7ad6820d-1e7d-469c-bb24-5c20106c04d9 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:35.529542 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-7ad6820d-1e7d-469c-bb24-5c20106c04d9 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/45f65f98-e1ca-4e07-872a-ef0403e2d50a" status: 200 len: 1522 microversion: 2.1 time: 0.148879 Jun 07 14:41:35.530088 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 155/296] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:41:35 2022] GET /compute/v2.1/servers/45f65f98-e1ca-4e07-872a-ef0403e2d50a => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:41:36.547458 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-9fb16c2e-730d-40ec-9eda-9022e068e686 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:41:36.548240 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-9fb16c2e-730d-40ec-9eda-9022e068e686 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 45f65f98-e1ca-4e07-872a-ef0403e2d50a] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:41:36.554940 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-9fb16c2e-730d-40ec-9eda-9022e068e686 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:36.555428 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-9fb16c2e-730d-40ec-9eda-9022e068e686 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:36.557458 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-9fb16c2e-730d-40ec-9eda-9022e068e686 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:36.557458 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-9fb16c2e-730d-40ec-9eda-9022e068e686 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:36.690980 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-9fb16c2e-730d-40ec-9eda-9022e068e686 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:36.698598 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-9fb16c2e-730d-40ec-9eda-9022e068e686 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/45f65f98-e1ca-4e07-872a-ef0403e2d50a" status: 200 len: 1522 microversion: 2.1 time: 0.155076 Jun 07 14:41:36.699153 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 142/297] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:41:36 2022] GET /compute/v2.1/servers/45f65f98-e1ca-4e07-872a-ef0403e2d50a => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:41:37.715841 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-84a58f99-11ec-4e87-a874-07af18c1dbbf tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:41:37.716497 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-84a58f99-11ec-4e87-a874-07af18c1dbbf tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 45f65f98-e1ca-4e07-872a-ef0403e2d50a] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:41:37.723022 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-84a58f99-11ec-4e87-a874-07af18c1dbbf tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:37.723480 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-84a58f99-11ec-4e87-a874-07af18c1dbbf tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:37.724256 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-84a58f99-11ec-4e87-a874-07af18c1dbbf tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:37.724834 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-84a58f99-11ec-4e87-a874-07af18c1dbbf tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:37.920674 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-84a58f99-11ec-4e87-a874-07af18c1dbbf tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:37.930374 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-84a58f99-11ec-4e87-a874-07af18c1dbbf tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/45f65f98-e1ca-4e07-872a-ef0403e2d50a" status: 200 len: 1522 microversion: 2.1 time: 0.218209 Jun 07 14:41:37.933379 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 156/298] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:41:37 2022] GET /compute/v2.1/servers/45f65f98-e1ca-4e07-872a-ef0403e2d50a => generated 1522 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:41:38.951783 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-4283d584-4aa5-45cd-bd84-eeb1387ad6c6 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:41:38.952774 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-4283d584-4aa5-45cd-bd84-eeb1387ad6c6 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 45f65f98-e1ca-4e07-872a-ef0403e2d50a] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:41:38.966477 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-4283d584-4aa5-45cd-bd84-eeb1387ad6c6 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:38.966936 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-4283d584-4aa5-45cd-bd84-eeb1387ad6c6 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:38.967718 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-4283d584-4aa5-45cd-bd84-eeb1387ad6c6 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:38.972329 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-4283d584-4aa5-45cd-bd84-eeb1387ad6c6 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:39.157275 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-4283d584-4aa5-45cd-bd84-eeb1387ad6c6 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:39.179067 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-4283d584-4aa5-45cd-bd84-eeb1387ad6c6 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/45f65f98-e1ca-4e07-872a-ef0403e2d50a" status: 200 len: 1502 microversion: 2.1 time: 0.233773 Jun 07 14:41:39.189149 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 143/299] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:41:38 2022] GET /compute/v2.1/servers/45f65f98-e1ca-4e07-872a-ef0403e2d50a => generated 1502 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:41:39.200635 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-69b78b44-c5eb-4ba4-9439-76ab873d0877 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "239640e0-82c6-43f6-83d4-99fa33e8fff1"}} {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:41:39.202002 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-69b78b44-c5eb-4ba4-9439-76ab873d0877 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 45f65f98-e1ca-4e07-872a-ef0403e2d50a] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:41:39.208965 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-69b78b44-c5eb-4ba4-9439-76ab873d0877 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:39.209558 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-69b78b44-c5eb-4ba4-9439-76ab873d0877 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:39.210442 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-69b78b44-c5eb-4ba4-9439-76ab873d0877 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:39.211105 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-69b78b44-c5eb-4ba4-9439-76ab873d0877 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:39.247220 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.wsgi [None req-69b78b44-c5eb-4ba4-9439-76ab873d0877 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] HTTP exception thrown: Cannot 'attach_volume' instance 45f65f98-e1ca-4e07-872a-ef0403e2d50a while it is in vm_state rescued Jun 07 14:41:39.249002 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-69b78b44-c5eb-4ba4-9439-76ab873d0877 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Request method failure captured: Jun 07 14:41:39.249002 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: request: POST /compute/v2.1/servers/45f65f98-e1ca-4e07-872a-ef0403e2d50a/os-volume_attachments HTTP/1.1 Jun 07 14:41:39.249002 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Accept: application/json Jun 07 14:41:39.249002 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Accept-Encoding: identity Jun 07 14:41:39.249002 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Connection: close Jun 07 14:41:39.249002 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Content-Length: 74 Jun 07 14:41:39.249002 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Content-Type: application/json Jun 07 14:41:39.249002 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Host: 10.222.0.85 Jun 07 14:41:39.249002 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Openstack-System-Scope: None Jun 07 14:41:39.249002 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: User-Agent: python-urllib3/1.26.9 Jun 07 14:41:39.249002 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Auth-Token: gAAAAABin2MfoYDVhu2np0DRcQVNUXdKMfJ65XCHwNNgDzofb7UJB-BWXWBLWaEswfOjFb54DUFMtQxlwkMGgXmEQLjfj_mQyFqyWAiCHR0I3nl7bqHSoOmAgQ9B8P9sCJ5_1DmOjuYjvvS65ktGlA1sVBmQ3mMGWuAH2ULxrW_BKmx6e7vrexU Jun 07 14:41:39.249002 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Domain-Id: None Jun 07 14:41:39.249002 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Domain-Name: None Jun 07 14:41:39.249002 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Identity-Status: Confirmed Jun 07 14:41:39.249002 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Is-Admin-Project: True Jun 07 14:41:39.249002 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Domain-Id: default Jun 07 14:41:39.249002 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Domain-Name: Default Jun 07 14:41:39.249002 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Id: e80aa19d008640df9a1f924a7c03f7f6 Jun 07 14:41:39.249002 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1172669914 Jun 07 14:41:39.249002 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Role: member,reader Jun 07 14:41:39.249002 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Roles: member,reader Jun 07 14:41:39.250474 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e80aa19d008640df9a1f924a7c03f7f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_e80aa19d008640df9a1f924a7c03f7f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e80aa19d008640df9a1f924a7c03f7f6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/e80aa19d008640df9a1f924a7c03f7f6"}]}] Jun 07 14:41:39.250474 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1172669914 Jun 07 14:41:39.250474 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Tenant-Id: e80aa19d008640df9a1f924a7c03f7f6 Jun 07 14:41:39.250474 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1172669914 Jun 07 14:41:39.250474 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User: tempest-ServerRescueNegativeTestJSON-1172669914-project Jun 07 14:41:39.250474 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Domain-Id: default Jun 07 14:41:39.250474 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Domain-Name: Default Jun 07 14:41:39.250474 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Id: 48bbf88b32774d5da9ef93ac75686c34 Jun 07 14:41:39.250474 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1172669914-project Jun 07 14:41:39.250474 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Jun 07 14:41:39.250474 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: {"volumeAttachment": {"volumeId": "239640e0-82c6-43f6-83d4-99fa33e8fff1"}} Jun 07 14:41:39.250474 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: method: > Jun 07 14:41:39.251314 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: exception: Cannot 'attach_volume' instance 45f65f98-e1ca-4e07-872a-ef0403e2d50a while it is in vm_state rescued Jun 07 14:41:39.251314 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: action_args: {'server_id': '45f65f98-e1ca-4e07-872a-ef0403e2d50a', 'body': {'volumeAttachment': {'volumeId': '239640e0-82c6-43f6-83d4-99fa33e8fff1'}}} Jun 07 14:41:39.251314 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:41:39.251314 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:41:39.251314 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 07 14:41:39.251314 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 07 14:41:39.251314 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 07 14:41:39.251314 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 07 14:41:39.251314 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 07 14:41:39.251314 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 07 14:41:39.251314 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 45f65f98-e1ca-4e07-872a-ef0403e2d50a in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 07 14:41:39.251314 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:41:39.251314 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:41:39.251314 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:41:39.251314 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:41:39.251314 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:41:39.251314 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:41:39.251314 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:41:39.251314 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:41:39.252821 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:41:39.252821 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:41:39.252821 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 07 14:41:39.252821 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 14:41:39.252821 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 07 14:41:39.252821 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 14:41:39.252821 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 07 14:41:39.252821 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 14:41:39.252821 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 07 14:41:39.252821 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 07 14:41:39.252821 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 07 14:41:39.252821 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 07 14:41:39.252821 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 45f65f98-e1ca-4e07-872a-ef0403e2d50a while it is in vm_state rescued Jun 07 14:41:39.252821 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:41:39.252821 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:41:39.252821 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:41:39.252821 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:41:39.252821 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:41:39.252821 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:41:39.254315 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:41:39.254315 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:41:39.254315 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 45f65f98-e1ca-4e07-872a-ef0403e2d50a while it is in vm_state rescued Jun 07 14:41:39.254315 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:41:39.254315 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-69b78b44-c5eb-4ba4-9439-76ab873d0877 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Returning 409 to user: Cannot 'attach_volume' instance 45f65f98-e1ca-4e07-872a-ef0403e2d50a while it is in vm_state rescued {{(pid=118158) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:41:39.254315 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-69b78b44-c5eb-4ba4-9439-76ab873d0877 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "POST /compute/v2.1/servers/45f65f98-e1ca-4e07-872a-ef0403e2d50a/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.054512 Jun 07 14:41:39.255061 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 157/300] 10.222.0.85 () {60 vars in 1322 bytes} [Tue Jun 7 14:41:39 2022] POST /compute/v2.1/servers/45f65f98-e1ca-4e07-872a-ef0403e2d50a/os-volume_attachments => generated 152 bytes in 59 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 07 14:41:39.263398 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-cf985e9b-ff2d-4641-8b47-95125ba0276a tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:41:39.263904 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-cf985e9b-ff2d-4641-8b47-95125ba0276a tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 45f65f98-e1ca-4e07-872a-ef0403e2d50a] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:41:39.270301 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-cf985e9b-ff2d-4641-8b47-95125ba0276a tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:39.270752 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-cf985e9b-ff2d-4641-8b47-95125ba0276a tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:39.271521 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-cf985e9b-ff2d-4641-8b47-95125ba0276a tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:39.272148 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-cf985e9b-ff2d-4641-8b47-95125ba0276a tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:39.545448 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-cf985e9b-ff2d-4641-8b47-95125ba0276a tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "POST /compute/v2.1/servers/45f65f98-e1ca-4e07-872a-ef0403e2d50a/action" status: 202 len: 0 microversion: 2.1 time: 0.285516 Jun 07 14:41:39.546104 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 144/301] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Jun 7 14:41:39 2022] POST /compute/v2.1/servers/45f65f98-e1ca-4e07-872a-ef0403e2d50a/action => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 14:41:39.554585 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-156f8d1d-43fc-4764-a1e9-09cb36a9274e tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:41:39.555274 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-156f8d1d-43fc-4764-a1e9-09cb36a9274e tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 45f65f98-e1ca-4e07-872a-ef0403e2d50a] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:41:39.562109 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-156f8d1d-43fc-4764-a1e9-09cb36a9274e tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:39.562586 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-156f8d1d-43fc-4764-a1e9-09cb36a9274e tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:39.563368 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-156f8d1d-43fc-4764-a1e9-09cb36a9274e tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:39.563809 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-156f8d1d-43fc-4764-a1e9-09cb36a9274e tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:39.721772 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-156f8d1d-43fc-4764-a1e9-09cb36a9274e tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:39.731122 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-156f8d1d-43fc-4764-a1e9-09cb36a9274e tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/45f65f98-e1ca-4e07-872a-ef0403e2d50a" status: 200 len: 1510 microversion: 2.1 time: 0.180259 Jun 07 14:41:39.732120 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 158/302] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:41:39 2022] GET /compute/v2.1/servers/45f65f98-e1ca-4e07-872a-ef0403e2d50a => generated 1510 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:41:40.749777 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-d5dcf484-b95e-48a9-b81b-a6bddeb8cfd4 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:41:40.751117 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-d5dcf484-b95e-48a9-b81b-a6bddeb8cfd4 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 45f65f98-e1ca-4e07-872a-ef0403e2d50a] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:41:40.757827 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-d5dcf484-b95e-48a9-b81b-a6bddeb8cfd4 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:40.758499 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-d5dcf484-b95e-48a9-b81b-a6bddeb8cfd4 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:40.760837 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-d5dcf484-b95e-48a9-b81b-a6bddeb8cfd4 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:40.760837 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-d5dcf484-b95e-48a9-b81b-a6bddeb8cfd4 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:40.896761 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-d5dcf484-b95e-48a9-b81b-a6bddeb8cfd4 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:40.904500 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-d5dcf484-b95e-48a9-b81b-a6bddeb8cfd4 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/45f65f98-e1ca-4e07-872a-ef0403e2d50a" status: 200 len: 1510 microversion: 2.1 time: 0.159541 Jun 07 14:41:40.905068 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 145/303] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:41:40 2022] GET /compute/v2.1/servers/45f65f98-e1ca-4e07-872a-ef0403e2d50a => generated 1510 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:41:41.922149 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-0ce7c678-673d-40e9-bb68-765c52391e81 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:41:41.922757 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-0ce7c678-673d-40e9-bb68-765c52391e81 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 45f65f98-e1ca-4e07-872a-ef0403e2d50a] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:41:41.929513 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-0ce7c678-673d-40e9-bb68-765c52391e81 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:41.930053 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-0ce7c678-673d-40e9-bb68-765c52391e81 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:41.930750 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-0ce7c678-673d-40e9-bb68-765c52391e81 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:41.931186 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-0ce7c678-673d-40e9-bb68-765c52391e81 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:42.065652 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-0ce7c678-673d-40e9-bb68-765c52391e81 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:42.074155 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-0ce7c678-673d-40e9-bb68-765c52391e81 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/45f65f98-e1ca-4e07-872a-ef0403e2d50a" status: 200 len: 1510 microversion: 2.1 time: 0.156235 Jun 07 14:41:42.074714 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 159/304] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:41:41 2022] GET /compute/v2.1/servers/45f65f98-e1ca-4e07-872a-ef0403e2d50a => generated 1510 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:41:43.091897 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-b083a798-efa1-4bd7-9980-2ce9433565ff tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:41:43.092632 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-b083a798-efa1-4bd7-9980-2ce9433565ff tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 45f65f98-e1ca-4e07-872a-ef0403e2d50a] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:41:43.095070 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG dbcounter [-] [118157] Writing DB stats nova_api:SELECT=50 {{(pid=118157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:41:43.099691 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-b083a798-efa1-4bd7-9980-2ce9433565ff tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:43.100140 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-b083a798-efa1-4bd7-9980-2ce9433565ff tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:43.101013 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-b083a798-efa1-4bd7-9980-2ce9433565ff tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:43.101450 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-b083a798-efa1-4bd7-9980-2ce9433565ff tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:43.237859 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-b083a798-efa1-4bd7-9980-2ce9433565ff tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:43.245955 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-b083a798-efa1-4bd7-9980-2ce9433565ff tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/45f65f98-e1ca-4e07-872a-ef0403e2d50a" status: 200 len: 1510 microversion: 2.1 time: 0.158114 Jun 07 14:41:43.246511 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 146/305] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:41:43 2022] GET /compute/v2.1/servers/45f65f98-e1ca-4e07-872a-ef0403e2d50a => generated 1510 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:41:44.263473 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-947bb0aa-743f-43f9-9c52-1e78ec116405 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:41:44.264088 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-947bb0aa-743f-43f9-9c52-1e78ec116405 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 45f65f98-e1ca-4e07-872a-ef0403e2d50a] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:41:44.270467 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-947bb0aa-743f-43f9-9c52-1e78ec116405 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:44.270993 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-947bb0aa-743f-43f9-9c52-1e78ec116405 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:44.271768 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-947bb0aa-743f-43f9-9c52-1e78ec116405 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:44.272803 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-947bb0aa-743f-43f9-9c52-1e78ec116405 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:44.460401 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-947bb0aa-743f-43f9-9c52-1e78ec116405 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:44.468563 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-947bb0aa-743f-43f9-9c52-1e78ec116405 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/45f65f98-e1ca-4e07-872a-ef0403e2d50a" status: 200 len: 1516 microversion: 2.1 time: 0.208837 Jun 07 14:41:44.469134 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 160/306] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:41:44 2022] GET /compute/v2.1/servers/45f65f98-e1ca-4e07-872a-ef0403e2d50a => generated 1516 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:41:47.121801 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-9bf3e542-071b-4600-9a24-6ffc22b667e8 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Action: 'create', calling method: .version_select at 0x7f5f88158160>, body: {"keypair": {"name": "tempest-keypair-385740061", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCiFGZKL6OcmiOpU81+dy+tjckIuoy14pmtEOVzPgjq1xfGD59Hk+n4FaiOMv5A2g6/vfP/MDj+3y7Zo50f8Zo4dTA9koRrSmOy/P1on6ZGb5Xtso2hf4BSOV1vT0AvspQ=="}} {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:41:47.140785 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.quota [None req-9bf3e542-071b-4600-9a24-6ffc22b667e8 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Getting quotas for project e80aa19d008640df9a1f924a7c03f7f6. Resources: {'key_pairs'} {{(pid=118157) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 14:41:47.144994 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.quota [None req-9bf3e542-071b-4600-9a24-6ffc22b667e8 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Getting quotas for user 48bbf88b32774d5da9ef93ac75686c34 and project e80aa19d008640df9a1f924a7c03f7f6. Resources: {'key_pairs'} {{(pid=118157) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 14:41:47.268219 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-9bf3e542-071b-4600-9a24-6ffc22b667e8 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.150291 Jun 07 14:41:47.268757 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 147/307] 10.222.0.85 () {60 vars in 1158 bytes} [Tue Jun 7 14:41:47 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:41:49.704569 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-86adc8ba-55cc-4024-bca4-c3a0734085bd tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-241274251", "imageRef": "7802ce25-d370-43a3-8d85-0257d644d539", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fe436814-4d43-40f4-a910-26ab3da64594"}], "security_groups": [{"name": "tempest-securitygroup--1824202245"}], "key_name": "tempest-keypair-385740061", "user_data": "}} {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:41:49.817673 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.network.neutron [None req-86adc8ba-55cc-4024-bca4-c3a0734085bd tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] validate_networks() for [('fe436814-4d43-40f4-a910-26ab3da64594', None, None, None, None, None)] {{(pid=118158) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 14:41:50.194716 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.virt.hardware [None req-86adc8ba-55cc-4024-bca4-c3a0734085bd tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Flavor limits 0:0:0 {{(pid=118158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 14:41:50.195306 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.virt.hardware [None req-86adc8ba-55cc-4024-bca4-c3a0734085bd tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Image limits 0:0:0 {{(pid=118158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 14:41:50.195711 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.virt.hardware [None req-86adc8ba-55cc-4024-bca4-c3a0734085bd tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Flavor pref 0:0:0 {{(pid=118158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 14:41:50.196127 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.virt.hardware [None req-86adc8ba-55cc-4024-bca4-c3a0734085bd tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Image pref 0:0:0 {{(pid=118158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 14:41:50.196575 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.virt.hardware [None req-86adc8ba-55cc-4024-bca4-c3a0734085bd tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 14:41:50.205485 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-86adc8ba-55cc-4024-bca4-c3a0734085bd tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:50.205938 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-86adc8ba-55cc-4024-bca4-c3a0734085bd tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:50.206784 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-86adc8ba-55cc-4024-bca4-c3a0734085bd tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:50.207232 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-86adc8ba-55cc-4024-bca4-c3a0734085bd tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:50.224584 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.quota [None req-86adc8ba-55cc-4024-bca4-c3a0734085bd tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Getting quotas for project e80aa19d008640df9a1f924a7c03f7f6. Resources: {'instances', 'cores', 'ram'} {{(pid=118158) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 14:41:50.229974 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.quota [None req-86adc8ba-55cc-4024-bca4-c3a0734085bd tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Getting quotas for user 48bbf88b32774d5da9ef93ac75686c34 and project e80aa19d008640df9a1f924a7c03f7f6. Resources: {'instances', 'cores', 'ram'} {{(pid=118158) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 14:41:50.241640 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-86adc8ba-55cc-4024-bca4-c3a0734085bd tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Going to run 1 instances... {{(pid=118158) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 14:41:50.243896 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-86adc8ba-55cc-4024-bca4-c3a0734085bd tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 7dec201c-634b-4b93-bc30-0ac8e60795c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7802ce25-d370-43a3-8d85-0257d644d539',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118158) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 14:41:50.515377 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-86adc8ba-55cc-4024-bca4-c3a0734085bd tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.816861 Jun 07 14:41:50.516026 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 161/308] 10.222.0.85 () {60 vars in 1146 bytes} [Tue Jun 7 14:41:49 2022] POST /compute/v2.1/servers => generated 409 bytes in 818 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 14:41:50.526626 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-670ee036-14a4-4fd9-9a3e-558238bf87c5 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:41:50.527244 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-670ee036-14a4-4fd9-9a3e-558238bf87c5 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 7dec201c-634b-4b93-bc30-0ac8e60795c7] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:41:50.604679 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-670ee036-14a4-4fd9-9a3e-558238bf87c5 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:50.604679 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-670ee036-14a4-4fd9-9a3e-558238bf87c5 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7" status: 200 len: 1244 microversion: 2.1 time: 0.074994 Jun 07 14:41:50.604679 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 148/309] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:41:50 2022] GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7 => generated 1244 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:41:51.620065 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-7d25a7f6-c9a3-440b-b603-3d7d0e525f89 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:41:51.620748 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-7d25a7f6-c9a3-440b-b603-3d7d0e525f89 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 7dec201c-634b-4b93-bc30-0ac8e60795c7] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:41:51.627372 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-7d25a7f6-c9a3-440b-b603-3d7d0e525f89 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:51.627959 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-7d25a7f6-c9a3-440b-b603-3d7d0e525f89 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:51.628790 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-7d25a7f6-c9a3-440b-b603-3d7d0e525f89 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:51.629233 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-7d25a7f6-c9a3-440b-b603-3d7d0e525f89 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:51.696091 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-7d25a7f6-c9a3-440b-b603-3d7d0e525f89 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:51.707536 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-7d25a7f6-c9a3-440b-b603-3d7d0e525f89 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7" status: 200 len: 1248 microversion: 2.1 time: 0.091672 Jun 07 14:41:51.708393 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 162/310] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:41:51 2022] GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7 => generated 1248 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:41:52.727247 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-360603c9-8f47-40b6-b0d3-29f81f94ccbb tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:41:52.728096 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-360603c9-8f47-40b6-b0d3-29f81f94ccbb tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 7dec201c-634b-4b93-bc30-0ac8e60795c7] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:41:52.735285 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-360603c9-8f47-40b6-b0d3-29f81f94ccbb tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:52.735803 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-360603c9-8f47-40b6-b0d3-29f81f94ccbb tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:52.736687 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-360603c9-8f47-40b6-b0d3-29f81f94ccbb tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:52.737187 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-360603c9-8f47-40b6-b0d3-29f81f94ccbb tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:52.818808 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-360603c9-8f47-40b6-b0d3-29f81f94ccbb tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:52.827857 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-360603c9-8f47-40b6-b0d3-29f81f94ccbb tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7" status: 200 len: 1304 microversion: 2.1 time: 0.105254 Jun 07 14:41:52.828455 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 149/311] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:41:52 2022] GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7 => generated 1304 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:41:53.848093 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-2dc1dd98-fbea-429d-9592-65986c594e42 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:41:53.848737 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-2dc1dd98-fbea-429d-9592-65986c594e42 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 7dec201c-634b-4b93-bc30-0ac8e60795c7] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:41:53.855705 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-2dc1dd98-fbea-429d-9592-65986c594e42 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:53.856172 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-2dc1dd98-fbea-429d-9592-65986c594e42 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:53.856940 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-2dc1dd98-fbea-429d-9592-65986c594e42 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:53.857424 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-2dc1dd98-fbea-429d-9592-65986c594e42 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:53.987757 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-2dc1dd98-fbea-429d-9592-65986c594e42 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:53.995456 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-2dc1dd98-fbea-429d-9592-65986c594e42 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7" status: 200 len: 1370 microversion: 2.1 time: 0.151368 Jun 07 14:41:53.996179 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 163/312] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:41:53 2022] GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7 => generated 1370 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:41:54.375298 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [req-6b7d686a-9d0e-404b-a190-e7bcdcfda141 req-cbfa9caf-da83-4083-942e-68231cc948e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7dec201c-634b-4b93-bc30-0ac8e60795c7", "tag": "c9370c3f-495d-4859-9ac6-25184d933583"}]} {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:41:54.385582 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [req-6b7d686a-9d0e-404b-a190-e7bcdcfda141 req-cbfa9caf-da83-4083-942e-68231cc948e7 service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:54.386244 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [req-6b7d686a-9d0e-404b-a190-e7bcdcfda141 req-cbfa9caf-da83-4083-942e-68231cc948e7 service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:54.398497 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.compute.server_external_events [req-6b7d686a-9d0e-404b-a190-e7bcdcfda141 req-cbfa9caf-da83-4083-942e-68231cc948e7 service nova] Creating event network-changed:c9370c3f-495d-4859-9ac6-25184d933583 for instance 7dec201c-634b-4b93-bc30-0ac8e60795c7 on hv-cinder-84497 Jun 07 14:41:54.403818 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [req-6b7d686a-9d0e-404b-a190-e7bcdcfda141 req-cbfa9caf-da83-4083-942e-68231cc948e7 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032160 Jun 07 14:41:54.404486 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 150/313] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jun 7 14:41:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 14:41:55.013247 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-5e825ecc-3abf-4b43-ab8d-97bb00c24619 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:41:55.014019 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-5e825ecc-3abf-4b43-ab8d-97bb00c24619 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 7dec201c-634b-4b93-bc30-0ac8e60795c7] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:41:55.022810 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5e825ecc-3abf-4b43-ab8d-97bb00c24619 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:55.022810 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5e825ecc-3abf-4b43-ab8d-97bb00c24619 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:55.023030 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5e825ecc-3abf-4b43-ab8d-97bb00c24619 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:55.023432 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5e825ecc-3abf-4b43-ab8d-97bb00c24619 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:55.157113 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-5e825ecc-3abf-4b43-ab8d-97bb00c24619 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:55.164587 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-5e825ecc-3abf-4b43-ab8d-97bb00c24619 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7" status: 200 len: 1370 microversion: 2.1 time: 0.155326 Jun 07 14:41:55.165147 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 164/314] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:41:55 2022] GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7 => generated 1370 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:41:56.182576 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-6c0dc5e2-da61-468d-a1a3-e4c3936b1180 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:41:56.183271 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-6c0dc5e2-da61-468d-a1a3-e4c3936b1180 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 7dec201c-634b-4b93-bc30-0ac8e60795c7] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:41:56.189587 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-6c0dc5e2-da61-468d-a1a3-e4c3936b1180 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:56.190043 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-6c0dc5e2-da61-468d-a1a3-e4c3936b1180 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:56.190807 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-6c0dc5e2-da61-468d-a1a3-e4c3936b1180 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:56.191242 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-6c0dc5e2-da61-468d-a1a3-e4c3936b1180 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:56.322394 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-6c0dc5e2-da61-468d-a1a3-e4c3936b1180 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:56.334044 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-6c0dc5e2-da61-468d-a1a3-e4c3936b1180 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7" status: 200 len: 1370 microversion: 2.1 time: 0.152007 Jun 07 14:41:56.334044 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 151/315] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:41:56 2022] GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7 => generated 1370 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:41:57.347155 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-3ec2307c-6689-4212-bdd7-6795ea6dcb66 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:41:57.347764 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-3ec2307c-6689-4212-bdd7-6795ea6dcb66 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 7dec201c-634b-4b93-bc30-0ac8e60795c7] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:41:57.354303 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-3ec2307c-6689-4212-bdd7-6795ea6dcb66 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:57.354756 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-3ec2307c-6689-4212-bdd7-6795ea6dcb66 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:57.355538 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-3ec2307c-6689-4212-bdd7-6795ea6dcb66 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:57.355973 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-3ec2307c-6689-4212-bdd7-6795ea6dcb66 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:57.482564 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-3ec2307c-6689-4212-bdd7-6795ea6dcb66 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:57.489927 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-3ec2307c-6689-4212-bdd7-6795ea6dcb66 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7" status: 200 len: 1370 microversion: 2.1 time: 0.146638 Jun 07 14:41:57.490387 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 165/316] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:41:57 2022] GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7 => generated 1370 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:41:58.505562 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-ffabda0a-b1fe-4f32-873e-603e3cdfbcd0 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:41:58.506183 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-ffabda0a-b1fe-4f32-873e-603e3cdfbcd0 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 7dec201c-634b-4b93-bc30-0ac8e60795c7] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:41:58.513362 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-ffabda0a-b1fe-4f32-873e-603e3cdfbcd0 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:58.513752 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-ffabda0a-b1fe-4f32-873e-603e3cdfbcd0 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:58.514524 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-ffabda0a-b1fe-4f32-873e-603e3cdfbcd0 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:58.514965 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-ffabda0a-b1fe-4f32-873e-603e3cdfbcd0 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:58.644854 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-ffabda0a-b1fe-4f32-873e-603e3cdfbcd0 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:58.653169 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-ffabda0a-b1fe-4f32-873e-603e3cdfbcd0 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7" status: 200 len: 1370 microversion: 2.1 time: 0.151402 Jun 07 14:41:58.653735 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 152/317] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:41:58 2022] GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7 => generated 1370 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:41:59.671562 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-bf800d36-8f06-4aed-8459-06fb3e4a6348 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:41:59.671562 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-bf800d36-8f06-4aed-8459-06fb3e4a6348 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 7dec201c-634b-4b93-bc30-0ac8e60795c7] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:41:59.672264 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG dbcounter [-] [118158] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=118158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:41:59.677160 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-bf800d36-8f06-4aed-8459-06fb3e4a6348 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:59.677643 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-bf800d36-8f06-4aed-8459-06fb3e4a6348 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:59.678404 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-bf800d36-8f06-4aed-8459-06fb3e4a6348 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:41:59.678841 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-bf800d36-8f06-4aed-8459-06fb3e4a6348 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:41:59.683305 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG dbcounter [-] [118158] Writing DB stats nova_cell1:SELECT=93 {{(pid=118158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:41:59.809645 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-bf800d36-8f06-4aed-8459-06fb3e4a6348 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:41:59.817135 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-bf800d36-8f06-4aed-8459-06fb3e4a6348 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7" status: 200 len: 1370 microversion: 2.1 time: 0.151443 Jun 07 14:41:59.817699 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 166/318] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:41:59 2022] GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7 => generated 1370 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:42:00.834516 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-991d35b6-8941-43b7-9eef-9884f86334ea tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:42:00.835111 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-991d35b6-8941-43b7-9eef-9884f86334ea tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 7dec201c-634b-4b93-bc30-0ac8e60795c7] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:42:00.838131 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG dbcounter [-] [118157] Writing DB stats nova_cell0:SELECT=6 {{(pid=118157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:42:00.842976 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-991d35b6-8941-43b7-9eef-9884f86334ea tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:42:00.843427 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-991d35b6-8941-43b7-9eef-9884f86334ea tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:42:00.844360 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-991d35b6-8941-43b7-9eef-9884f86334ea tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:42:00.844625 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-991d35b6-8941-43b7-9eef-9884f86334ea tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:42:00.848449 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG dbcounter [-] [118157] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:42:01.201679 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-991d35b6-8941-43b7-9eef-9884f86334ea tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:42:01.208971 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-991d35b6-8941-43b7-9eef-9884f86334ea tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7" status: 200 len: 1370 microversion: 2.1 time: 0.378344 Jun 07 14:42:01.209519 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 153/319] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:42:00 2022] GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7 => generated 1370 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:42:02.226901 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-8a89721c-e88e-4461-a3f4-8c79a53abe49 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:42:02.227519 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-8a89721c-e88e-4461-a3f4-8c79a53abe49 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 7dec201c-634b-4b93-bc30-0ac8e60795c7] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:42:02.230028 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG dbcounter [-] [118158] Writing DB stats nova_cell0:SELECT=2 {{(pid=118158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:42:02.230690 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG dbcounter [-] [118158] Writing DB stats nova_cell0:SELECT=6 {{(pid=118158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:42:02.235720 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-8a89721c-e88e-4461-a3f4-8c79a53abe49 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:42:02.236173 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-8a89721c-e88e-4461-a3f4-8c79a53abe49 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:42:02.237022 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-8a89721c-e88e-4461-a3f4-8c79a53abe49 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:42:02.237465 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-8a89721c-e88e-4461-a3f4-8c79a53abe49 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:42:02.371353 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-8a89721c-e88e-4461-a3f4-8c79a53abe49 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:42:02.378680 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-8a89721c-e88e-4461-a3f4-8c79a53abe49 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7" status: 200 len: 1370 microversion: 2.1 time: 0.155951 Jun 07 14:42:02.379194 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 167/320] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:42:02 2022] GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7 => generated 1370 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:42:03.397441 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-d9621ea3-f2fe-4a24-9dd4-9a94a7a6f679 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:42:03.398088 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-d9621ea3-f2fe-4a24-9dd4-9a94a7a6f679 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 7dec201c-634b-4b93-bc30-0ac8e60795c7] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:42:03.404965 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-d9621ea3-f2fe-4a24-9dd4-9a94a7a6f679 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:42:03.405421 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-d9621ea3-f2fe-4a24-9dd4-9a94a7a6f679 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:42:03.406196 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-d9621ea3-f2fe-4a24-9dd4-9a94a7a6f679 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:42:03.406686 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-d9621ea3-f2fe-4a24-9dd4-9a94a7a6f679 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:42:03.536891 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-d9621ea3-f2fe-4a24-9dd4-9a94a7a6f679 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:42:03.546180 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-d9621ea3-f2fe-4a24-9dd4-9a94a7a6f679 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7" status: 200 len: 1370 microversion: 2.1 time: 0.152923 Jun 07 14:42:03.546919 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 154/321] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:42:03 2022] GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7 => generated 1370 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:42:04.469730 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [req-96f1fe22-e0c2-477d-97d4-3e0e15eec756 req-06548fb7-ba21-492c-97f2-cb2e841fd31d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dec201c-634b-4b93-bc30-0ac8e60795c7", "name": "network-vif-plugged", "status": "completed", "tag": "c9370c3f-495d-4859-9ac6-25184d933583"}]} {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:42:04.478138 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [req-96f1fe22-e0c2-477d-97d4-3e0e15eec756 req-06548fb7-ba21-492c-97f2-cb2e841fd31d service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:42:04.478584 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [req-96f1fe22-e0c2-477d-97d4-3e0e15eec756 req-06548fb7-ba21-492c-97f2-cb2e841fd31d service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:42:04.490045 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.compute.server_external_events [req-96f1fe22-e0c2-477d-97d4-3e0e15eec756 req-06548fb7-ba21-492c-97f2-cb2e841fd31d service nova] Creating event network-vif-plugged:c9370c3f-495d-4859-9ac6-25184d933583 for instance 7dec201c-634b-4b93-bc30-0ac8e60795c7 on hv-cinder-84497 Jun 07 14:42:04.495517 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [req-96f1fe22-e0c2-477d-97d4-3e0e15eec756 req-06548fb7-ba21-492c-97f2-cb2e841fd31d service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029977 Jun 07 14:42:04.496133 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 168/322] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jun 7 14:42:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:42:04.563184 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-7011117c-c8b7-462a-b739-d3789750fcdb tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:42:04.564587 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-7011117c-c8b7-462a-b739-d3789750fcdb tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 7dec201c-634b-4b93-bc30-0ac8e60795c7] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:42:04.571524 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-7011117c-c8b7-462a-b739-d3789750fcdb tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:42:04.572002 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-7011117c-c8b7-462a-b739-d3789750fcdb tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:42:04.572857 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-7011117c-c8b7-462a-b739-d3789750fcdb tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:42:04.573300 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-7011117c-c8b7-462a-b739-d3789750fcdb tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:42:04.708852 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-7011117c-c8b7-462a-b739-d3789750fcdb tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:42:04.716459 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-7011117c-c8b7-462a-b739-d3789750fcdb tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7" status: 200 len: 1370 microversion: 2.1 time: 0.157188 Jun 07 14:42:04.717014 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 155/323] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:42:04 2022] GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7 => generated 1370 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:42:05.736992 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-a91c4607-b9f4-40fd-bbc4-86dbbc206164 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:42:05.736992 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-a91c4607-b9f4-40fd-bbc4-86dbbc206164 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 7dec201c-634b-4b93-bc30-0ac8e60795c7] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:42:05.742031 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-a91c4607-b9f4-40fd-bbc4-86dbbc206164 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:42:05.742484 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-a91c4607-b9f4-40fd-bbc4-86dbbc206164 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:42:05.743253 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-a91c4607-b9f4-40fd-bbc4-86dbbc206164 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:42:05.743773 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-a91c4607-b9f4-40fd-bbc4-86dbbc206164 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:42:05.877593 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-a91c4607-b9f4-40fd-bbc4-86dbbc206164 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:42:05.885348 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-a91c4607-b9f4-40fd-bbc4-86dbbc206164 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7" status: 200 len: 1370 microversion: 2.1 time: 0.154833 Jun 07 14:42:05.888553 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 169/324] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:42:05 2022] GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7 => generated 1370 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:42:06.904952 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-2d85f27f-a343-4f7e-a05a-f5fc31e4e471 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:42:06.905486 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-2d85f27f-a343-4f7e-a05a-f5fc31e4e471 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 7dec201c-634b-4b93-bc30-0ac8e60795c7] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:42:06.911867 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-2d85f27f-a343-4f7e-a05a-f5fc31e4e471 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:42:06.912317 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-2d85f27f-a343-4f7e-a05a-f5fc31e4e471 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:42:06.913130 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-2d85f27f-a343-4f7e-a05a-f5fc31e4e471 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:42:06.913564 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-2d85f27f-a343-4f7e-a05a-f5fc31e4e471 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:42:07.044208 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-2d85f27f-a343-4f7e-a05a-f5fc31e4e471 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:42:07.051611 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-2d85f27f-a343-4f7e-a05a-f5fc31e4e471 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7" status: 200 len: 1370 microversion: 2.1 time: 0.150613 Jun 07 14:42:07.052166 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 156/325] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:42:06 2022] GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7 => generated 1370 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:42:08.069369 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-f67430ad-796f-4ce3-88dd-def2d4ad4624 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:42:08.069975 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-f67430ad-796f-4ce3-88dd-def2d4ad4624 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 7dec201c-634b-4b93-bc30-0ac8e60795c7] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:42:08.075901 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-f67430ad-796f-4ce3-88dd-def2d4ad4624 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:42:08.076346 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-f67430ad-796f-4ce3-88dd-def2d4ad4624 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:42:08.077127 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-f67430ad-796f-4ce3-88dd-def2d4ad4624 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:42:08.077556 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-f67430ad-796f-4ce3-88dd-def2d4ad4624 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:42:08.210453 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-f67430ad-796f-4ce3-88dd-def2d4ad4624 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:42:08.218433 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-f67430ad-796f-4ce3-88dd-def2d4ad4624 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7" status: 200 len: 1563 microversion: 2.1 time: 0.152917 Jun 07 14:42:08.218934 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 170/326] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:42:08 2022] GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7 => generated 1563 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:42:08.235268 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-355eec40-fb86-4670-a72e-650ce3702287 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:42:08.235836 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-355eec40-fb86-4670-a72e-650ce3702287 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 7dec201c-634b-4b93-bc30-0ac8e60795c7] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:42:08.242294 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-355eec40-fb86-4670-a72e-650ce3702287 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:42:08.242772 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-355eec40-fb86-4670-a72e-650ce3702287 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:42:08.243586 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-355eec40-fb86-4670-a72e-650ce3702287 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:42:08.244035 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-355eec40-fb86-4670-a72e-650ce3702287 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:42:08.333202 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-355eec40-fb86-4670-a72e-650ce3702287 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.101791 Jun 07 14:42:08.333782 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 157/327] 10.222.0.85 () {58 vars in 1274 bytes} [Tue Jun 7 14:42:08 2022] GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:42:09.417088 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [req-4c1a8caf-139d-4585-897f-fd54239c4332 req-47aa7b6f-404c-4259-848c-9fb07f7cdeca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7dec201c-634b-4b93-bc30-0ac8e60795c7", "tag": "c9370c3f-495d-4859-9ac6-25184d933583"}]} {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:42:09.425559 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [req-4c1a8caf-139d-4585-897f-fd54239c4332 req-47aa7b6f-404c-4259-848c-9fb07f7cdeca service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:42:09.426005 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [req-4c1a8caf-139d-4585-897f-fd54239c4332 req-47aa7b6f-404c-4259-848c-9fb07f7cdeca service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:42:09.437716 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.compute.server_external_events [req-4c1a8caf-139d-4585-897f-fd54239c4332 req-47aa7b6f-404c-4259-848c-9fb07f7cdeca service nova] Creating event network-changed:c9370c3f-495d-4859-9ac6-25184d933583 for instance 7dec201c-634b-4b93-bc30-0ac8e60795c7 on hv-cinder-84497 Jun 07 14:42:09.442796 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [req-4c1a8caf-139d-4585-897f-fd54239c4332 req-47aa7b6f-404c-4259-848c-9fb07f7cdeca service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030119 Jun 07 14:42:09.443387 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 171/328] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jun 7 14:42:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:42:25.280242 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG dbcounter [-] [118157] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=118157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:42:25.281160 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG dbcounter [-] [118157] Writing DB stats nova_cell1:SELECT=27 {{(pid=118157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:42:25.285015 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-c795ce07-bfb7-45a2-ad4a-c7be6a0b91f2 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-446735057", "imageRef": "7802ce25-d370-43a3-8d85-0257d644d539", "flavorRef": "452", "networks": [{"uuid": "ba704a6c-938d-40c0-bc6b-572841c7cd32"}]}} {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:42:25.344840 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.network.neutron [None req-c795ce07-bfb7-45a2-ad4a-c7be6a0b91f2 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] validate_networks() for [('ba704a6c-938d-40c0-bc6b-572841c7cd32', None, None, None, None, None)] {{(pid=118157) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 14:42:25.801713 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.virt.hardware [None req-c795ce07-bfb7-45a2-ad4a-c7be6a0b91f2 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Flavor limits 0:0:0 {{(pid=118157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 14:42:25.802145 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.virt.hardware [None req-c795ce07-bfb7-45a2-ad4a-c7be6a0b91f2 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Image limits 0:0:0 {{(pid=118157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 14:42:25.802624 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.virt.hardware [None req-c795ce07-bfb7-45a2-ad4a-c7be6a0b91f2 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Flavor pref 0:0:0 {{(pid=118157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 14:42:25.803037 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.virt.hardware [None req-c795ce07-bfb7-45a2-ad4a-c7be6a0b91f2 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Image pref 0:0:0 {{(pid=118157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 14:42:25.803627 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.virt.hardware [None req-c795ce07-bfb7-45a2-ad4a-c7be6a0b91f2 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 14:42:25.813664 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-c795ce07-bfb7-45a2-ad4a-c7be6a0b91f2 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:42:25.814337 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-c795ce07-bfb7-45a2-ad4a-c7be6a0b91f2 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:42:25.815312 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-c795ce07-bfb7-45a2-ad4a-c7be6a0b91f2 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:42:25.815925 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-c795ce07-bfb7-45a2-ad4a-c7be6a0b91f2 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:42:25.836038 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.quota [None req-c795ce07-bfb7-45a2-ad4a-c7be6a0b91f2 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Getting quotas for project 634574e706ee4f31bf4446871f11d5e0. Resources: {'instances', 'cores', 'ram'} {{(pid=118157) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 14:42:25.840521 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.quota [None req-c795ce07-bfb7-45a2-ad4a-c7be6a0b91f2 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Getting quotas for user a605008cb5474f168f572fd0a9e71193 and project 634574e706ee4f31bf4446871f11d5e0. Resources: {'instances', 'cores', 'ram'} {{(pid=118157) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 14:42:25.853375 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-c795ce07-bfb7-45a2-ad4a-c7be6a0b91f2 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Going to run 1 instances... {{(pid=118157) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 14:42:25.855907 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-c795ce07-bfb7-45a2-ad4a-c7be6a0b91f2 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] [instance: ac2c33a4-21c2-47b7-9a97-7e3d49c3653a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7802ce25-d370-43a3-8d85-0257d644d539',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118157) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 14:42:26.007152 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-c795ce07-bfb7-45a2-ad4a-c7be6a0b91f2 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.728256 Jun 07 14:42:26.014204 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 158/329] 10.222.0.85 () {60 vars in 1146 bytes} [Tue Jun 7 14:42:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 736 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 14:42:26.019478 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG dbcounter [-] [118158] Writing DB stats nova_api:SELECT=11 {{(pid=118158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:42:26.019478 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG dbcounter [-] [118158] Writing DB stats nova_cell1:SELECT=27 {{(pid=118158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:42:26.030549 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-c5a8b7ec-4913-44eb-95ef-140a1147a626 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:42:26.040616 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-c5a8b7ec-4913-44eb-95ef-140a1147a626 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] [instance: ac2c33a4-21c2-47b7-9a97-7e3d49c3653a] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:42:26.237461 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-c5a8b7ec-4913-44eb-95ef-140a1147a626 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a605008cb5474f168f572fd0a9e71193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634574e706ee4f31bf4446871f11d5e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:42:26.245195 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-c5a8b7ec-4913-44eb-95ef-140a1147a626 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] 10.222.0.85 "GET /compute/v2.1/servers/ac2c33a4-21c2-47b7-9a97-7e3d49c3653a" status: 200 len: 1218 microversion: 2.1 time: 0.229286 Jun 07 14:42:26.245901 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 172/330] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:42:26 2022] GET /compute/v2.1/servers/ac2c33a4-21c2-47b7-9a97-7e3d49c3653a => generated 1218 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:42:27.265173 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-8dae4170-a88e-4f37-a4ef-381db937fa57 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:42:27.266157 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-8dae4170-a88e-4f37-a4ef-381db937fa57 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] [instance: ac2c33a4-21c2-47b7-9a97-7e3d49c3653a] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:42:27.274850 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-8dae4170-a88e-4f37-a4ef-381db937fa57 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:42:27.274850 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-8dae4170-a88e-4f37-a4ef-381db937fa57 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:42:27.275702 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-8dae4170-a88e-4f37-a4ef-381db937fa57 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:42:27.276138 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-8dae4170-a88e-4f37-a4ef-381db937fa57 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:42:27.348930 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-8dae4170-a88e-4f37-a4ef-381db937fa57 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a605008cb5474f168f572fd0a9e71193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634574e706ee4f31bf4446871f11d5e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:42:27.358239 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-8dae4170-a88e-4f37-a4ef-381db937fa57 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] 10.222.0.85 "GET /compute/v2.1/servers/ac2c33a4-21c2-47b7-9a97-7e3d49c3653a" status: 200 len: 1222 microversion: 2.1 time: 0.099312 Jun 07 14:42:27.358239 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 159/331] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:42:27 2022] GET /compute/v2.1/servers/ac2c33a4-21c2-47b7-9a97-7e3d49c3653a => generated 1222 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:42:28.373638 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-f86cc87a-ac62-475f-a705-0ea905212464 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:42:28.374349 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-f86cc87a-ac62-475f-a705-0ea905212464 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] [instance: ac2c33a4-21c2-47b7-9a97-7e3d49c3653a] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:42:28.380638 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-f86cc87a-ac62-475f-a705-0ea905212464 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:42:28.381090 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-f86cc87a-ac62-475f-a705-0ea905212464 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:42:28.381854 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-f86cc87a-ac62-475f-a705-0ea905212464 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:42:28.382291 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-f86cc87a-ac62-475f-a705-0ea905212464 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:42:28.446235 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-f86cc87a-ac62-475f-a705-0ea905212464 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a605008cb5474f168f572fd0a9e71193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634574e706ee4f31bf4446871f11d5e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:42:28.454342 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-f86cc87a-ac62-475f-a705-0ea905212464 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] 10.222.0.85 "GET /compute/v2.1/servers/ac2c33a4-21c2-47b7-9a97-7e3d49c3653a" status: 200 len: 1270 microversion: 2.1 time: 0.084563 Jun 07 14:42:28.454916 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 173/332] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:42:28 2022] GET /compute/v2.1/servers/ac2c33a4-21c2-47b7-9a97-7e3d49c3653a => generated 1270 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:42:29.474261 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-99baa88f-a3d2-4c6a-a6f8-fc443ba5d9a4 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:42:29.476294 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-99baa88f-a3d2-4c6a-a6f8-fc443ba5d9a4 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] [instance: ac2c33a4-21c2-47b7-9a97-7e3d49c3653a] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:42:29.484745 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-99baa88f-a3d2-4c6a-a6f8-fc443ba5d9a4 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:42:29.486116 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-99baa88f-a3d2-4c6a-a6f8-fc443ba5d9a4 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:42:29.488532 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-99baa88f-a3d2-4c6a-a6f8-fc443ba5d9a4 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:42:29.488532 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-99baa88f-a3d2-4c6a-a6f8-fc443ba5d9a4 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:42:29.749214 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-99baa88f-a3d2-4c6a-a6f8-fc443ba5d9a4 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a605008cb5474f168f572fd0a9e71193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634574e706ee4f31bf4446871f11d5e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:42:29.769701 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-99baa88f-a3d2-4c6a-a6f8-fc443ba5d9a4 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] 10.222.0.85 "GET /compute/v2.1/servers/ac2c33a4-21c2-47b7-9a97-7e3d49c3653a" status: 200 len: 1318 microversion: 2.1 time: 0.299065 Jun 07 14:42:29.771429 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 160/333] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:42:29 2022] GET /compute/v2.1/servers/ac2c33a4-21c2-47b7-9a97-7e3d49c3653a => generated 1318 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:42:30.428038 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [req-5c4616c0-720a-4c8b-90d2-6a35fc7f23f2 req-91c861a3-8492-453d-b2eb-f4f6486d62f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac2c33a4-21c2-47b7-9a97-7e3d49c3653a", "tag": "e7624cd4-c440-4235-8255-0296b7b68288"}]} {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:42:30.452094 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [req-5c4616c0-720a-4c8b-90d2-6a35fc7f23f2 req-91c861a3-8492-453d-b2eb-f4f6486d62f5 service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:42:30.453642 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [req-5c4616c0-720a-4c8b-90d2-6a35fc7f23f2 req-91c861a3-8492-453d-b2eb-f4f6486d62f5 service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:42:30.465382 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.compute.server_external_events [req-5c4616c0-720a-4c8b-90d2-6a35fc7f23f2 req-91c861a3-8492-453d-b2eb-f4f6486d62f5 service nova] Creating event network-changed:e7624cd4-c440-4235-8255-0296b7b68288 for instance ac2c33a4-21c2-47b7-9a97-7e3d49c3653a on hv-cinder-84497 Jun 07 14:42:30.471048 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [req-5c4616c0-720a-4c8b-90d2-6a35fc7f23f2 req-91c861a3-8492-453d-b2eb-f4f6486d62f5 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048157 Jun 07 14:42:30.471650 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 174/334] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jun 7 14:42:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:42:30.787012 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-768a6f20-629c-43e5-b0c0-0e9e9f13245a tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:42:30.788202 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-768a6f20-629c-43e5-b0c0-0e9e9f13245a tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] [instance: ac2c33a4-21c2-47b7-9a97-7e3d49c3653a] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:42:30.795606 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-768a6f20-629c-43e5-b0c0-0e9e9f13245a tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:42:30.796063 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-768a6f20-629c-43e5-b0c0-0e9e9f13245a tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:42:30.797058 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-768a6f20-629c-43e5-b0c0-0e9e9f13245a tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:42:30.797498 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-768a6f20-629c-43e5-b0c0-0e9e9f13245a tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:42:31.102464 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-768a6f20-629c-43e5-b0c0-0e9e9f13245a tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a605008cb5474f168f572fd0a9e71193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634574e706ee4f31bf4446871f11d5e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:42:31.113071 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-768a6f20-629c-43e5-b0c0-0e9e9f13245a tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] 10.222.0.85 "GET /compute/v2.1/servers/ac2c33a4-21c2-47b7-9a97-7e3d49c3653a" status: 200 len: 1318 microversion: 2.1 time: 0.329772 Jun 07 14:42:31.114782 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 161/335] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:42:30 2022] GET /compute/v2.1/servers/ac2c33a4-21c2-47b7-9a97-7e3d49c3653a => generated 1318 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:42:32.132693 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-8639d6fe-22a9-42f4-b16f-44f7fb28f635 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:42:32.134071 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-8639d6fe-22a9-42f4-b16f-44f7fb28f635 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] [instance: ac2c33a4-21c2-47b7-9a97-7e3d49c3653a] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:42:32.142624 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-8639d6fe-22a9-42f4-b16f-44f7fb28f635 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:42:32.143284 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-8639d6fe-22a9-42f4-b16f-44f7fb28f635 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:42:32.144220 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-8639d6fe-22a9-42f4-b16f-44f7fb28f635 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:42:32.145015 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-8639d6fe-22a9-42f4-b16f-44f7fb28f635 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:42:32.402911 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-8639d6fe-22a9-42f4-b16f-44f7fb28f635 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a605008cb5474f168f572fd0a9e71193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634574e706ee4f31bf4446871f11d5e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:42:32.411661 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-8639d6fe-22a9-42f4-b16f-44f7fb28f635 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] 10.222.0.85 "GET /compute/v2.1/servers/ac2c33a4-21c2-47b7-9a97-7e3d49c3653a" status: 200 len: 1318 microversion: 2.1 time: 0.283166 Jun 07 14:42:32.411962 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 175/336] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:42:32 2022] GET /compute/v2.1/servers/ac2c33a4-21c2-47b7-9a97-7e3d49c3653a => generated 1318 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:42:33.428173 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-dcbb2b8b-0728-4198-9258-6eeacdd33c23 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:42:33.428825 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-dcbb2b8b-0728-4198-9258-6eeacdd33c23 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] [instance: ac2c33a4-21c2-47b7-9a97-7e3d49c3653a] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:42:33.436240 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-dcbb2b8b-0728-4198-9258-6eeacdd33c23 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:42:33.439207 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-dcbb2b8b-0728-4198-9258-6eeacdd33c23 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:42:33.439207 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-dcbb2b8b-0728-4198-9258-6eeacdd33c23 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:42:33.439207 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-dcbb2b8b-0728-4198-9258-6eeacdd33c23 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:42:33.568363 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-dcbb2b8b-0728-4198-9258-6eeacdd33c23 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a605008cb5474f168f572fd0a9e71193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634574e706ee4f31bf4446871f11d5e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:42:33.576435 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-dcbb2b8b-0728-4198-9258-6eeacdd33c23 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] 10.222.0.85 "GET /compute/v2.1/servers/ac2c33a4-21c2-47b7-9a97-7e3d49c3653a" status: 200 len: 1318 microversion: 2.1 time: 0.152014 Jun 07 14:42:33.577063 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 162/337] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:42:33 2022] GET /compute/v2.1/servers/ac2c33a4-21c2-47b7-9a97-7e3d49c3653a => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:42:34.593527 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-bc5359f8-e5bf-44f6-a840-8a36dfbe0d17 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:42:34.594156 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-bc5359f8-e5bf-44f6-a840-8a36dfbe0d17 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] [instance: ac2c33a4-21c2-47b7-9a97-7e3d49c3653a] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:42:34.606822 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-bc5359f8-e5bf-44f6-a840-8a36dfbe0d17 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:42:34.607265 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-bc5359f8-e5bf-44f6-a840-8a36dfbe0d17 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:42:34.608066 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-bc5359f8-e5bf-44f6-a840-8a36dfbe0d17 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:42:34.608537 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-bc5359f8-e5bf-44f6-a840-8a36dfbe0d17 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:42:35.030423 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-bc5359f8-e5bf-44f6-a840-8a36dfbe0d17 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a605008cb5474f168f572fd0a9e71193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634574e706ee4f31bf4446871f11d5e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:42:35.046693 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-bc5359f8-e5bf-44f6-a840-8a36dfbe0d17 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] 10.222.0.85 "GET /compute/v2.1/servers/ac2c33a4-21c2-47b7-9a97-7e3d49c3653a" status: 200 len: 1318 microversion: 2.1 time: 0.455128 Jun 07 14:42:35.056037 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 176/338] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:42:34 2022] GET /compute/v2.1/servers/ac2c33a4-21c2-47b7-9a97-7e3d49c3653a => generated 1318 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:42:35.302421 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-1395ed85-59c5-440d-8b3b-f4301a65283c tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Action: 'create', calling method: .version_select at 0x7f5f88100ee0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1252179120", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOhOUS9jX69kBSw+Zne5QB57a+os/vFtLrPFmCT62IeKUL6OaBSgRIYuC2JqW1VhGcj4CPSiToJJe7rNoLZSzRb/J4uBYpCZ5IRsji8vZk5lccF4V9YX/Hx2H1DjyzX0xA=="}} {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:42:35.316483 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.quota [None req-1395ed85-59c5-440d-8b3b-f4301a65283c tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Getting quotas for project 93e877695d0f46339cb4b9b86aac3662. Resources: {'key_pairs'} {{(pid=118157) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 14:42:35.320848 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.quota [None req-1395ed85-59c5-440d-8b3b-f4301a65283c tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Getting quotas for user 0a15f5fa82414bdf8ca3f6723c0a8d2d and project 93e877695d0f46339cb4b9b86aac3662. Resources: {'key_pairs'} {{(pid=118157) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 14:42:35.400111 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-1395ed85-59c5-440d-8b3b-f4301a65283c tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.290420 Jun 07 14:42:35.400772 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 163/339] 10.222.0.85 () {60 vars in 1158 bytes} [Tue Jun 7 14:42:35 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 14:42:36.069763 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-fd97aa8c-e1f9-43a4-9dff-33573dd4cab1 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:42:36.070531 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-fd97aa8c-e1f9-43a4-9dff-33573dd4cab1 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] [instance: ac2c33a4-21c2-47b7-9a97-7e3d49c3653a] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:42:36.077028 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-fd97aa8c-e1f9-43a4-9dff-33573dd4cab1 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:42:36.077558 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-fd97aa8c-e1f9-43a4-9dff-33573dd4cab1 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:42:36.078323 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-fd97aa8c-e1f9-43a4-9dff-33573dd4cab1 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:42:36.078749 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-fd97aa8c-e1f9-43a4-9dff-33573dd4cab1 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:42:36.234544 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-fd97aa8c-e1f9-43a4-9dff-33573dd4cab1 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a605008cb5474f168f572fd0a9e71193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634574e706ee4f31bf4446871f11d5e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:42:36.242304 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG dbcounter [-] [118158] Writing DB stats nova_cell0:SELECT=2 {{(pid=118158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:42:36.247179 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-fd97aa8c-e1f9-43a4-9dff-33573dd4cab1 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] 10.222.0.85 "GET /compute/v2.1/servers/ac2c33a4-21c2-47b7-9a97-7e3d49c3653a" status: 200 len: 1318 microversion: 2.1 time: 0.181782 Jun 07 14:42:36.248682 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 177/340] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:42:36 2022] GET /compute/v2.1/servers/ac2c33a4-21c2-47b7-9a97-7e3d49c3653a => generated 1318 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:42:37.023783 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [req-6846c7a7-7cf3-4be0-959a-43ac6c0fea09 req-bc3964a9-19bc-4f01-b1d6-ed8dcc8ef016 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac2c33a4-21c2-47b7-9a97-7e3d49c3653a", "name": "network-vif-plugged", "status": "completed", "tag": "e7624cd4-c440-4235-8255-0296b7b68288"}]} {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:42:37.033549 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG dbcounter [-] [118157] Writing DB stats nova_cell0:SELECT=2 {{(pid=118157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:42:37.044524 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [req-6846c7a7-7cf3-4be0-959a-43ac6c0fea09 req-bc3964a9-19bc-4f01-b1d6-ed8dcc8ef016 service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:42:37.047053 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [req-6846c7a7-7cf3-4be0-959a-43ac6c0fea09 req-bc3964a9-19bc-4f01-b1d6-ed8dcc8ef016 service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:42:37.058731 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.compute.server_external_events [req-6846c7a7-7cf3-4be0-959a-43ac6c0fea09 req-bc3964a9-19bc-4f01-b1d6-ed8dcc8ef016 service nova] Creating event network-vif-plugged:e7624cd4-c440-4235-8255-0296b7b68288 for instance ac2c33a4-21c2-47b7-9a97-7e3d49c3653a on hv-cinder-84497 Jun 07 14:42:37.064079 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [req-6846c7a7-7cf3-4be0-959a-43ac6c0fea09 req-bc3964a9-19bc-4f01-b1d6-ed8dcc8ef016 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048085 Jun 07 14:42:37.064897 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 164/341] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jun 7 14:42:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:42:37.078115 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-a57c2801-3ab7-470d-ac96-3e0c04ced8c2 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:42:37.078611 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-a57c2801-3ab7-470d-ac96-3e0c04ced8c2 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 314a1177-9252-4a27-8c30-0b7af796d9a5] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:42:37.085239 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-a57c2801-3ab7-470d-ac96-3e0c04ced8c2 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:42:37.085743 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-a57c2801-3ab7-470d-ac96-3e0c04ced8c2 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:42:37.087058 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-a57c2801-3ab7-470d-ac96-3e0c04ced8c2 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:42:37.087496 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-a57c2801-3ab7-470d-ac96-3e0c04ced8c2 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:42:37.114113 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-a57c2801-3ab7-470d-ac96-3e0c04ced8c2 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/314a1177-9252-4a27-8c30-0b7af796d9a5/ips" status: 200 len: 150 microversion: 2.1 time: 0.039993 Jun 07 14:42:37.120166 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 178/342] 10.222.0.85 () {58 vars in 1247 bytes} [Tue Jun 7 14:42:37 2022] GET /compute/v2.1/servers/314a1177-9252-4a27-8c30-0b7af796d9a5/ips => generated 150 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:42:37.267971 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-5aeb266c-2955-4c0b-8539-56c4283ffcb1 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:42:37.269043 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-5aeb266c-2955-4c0b-8539-56c4283ffcb1 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] [instance: ac2c33a4-21c2-47b7-9a97-7e3d49c3653a] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:42:37.285564 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-5aeb266c-2955-4c0b-8539-56c4283ffcb1 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:42:37.287550 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-5aeb266c-2955-4c0b-8539-56c4283ffcb1 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:42:37.289019 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-5aeb266c-2955-4c0b-8539-56c4283ffcb1 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:42:37.291430 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-5aeb266c-2955-4c0b-8539-56c4283ffcb1 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:42:37.517873 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-5aeb266c-2955-4c0b-8539-56c4283ffcb1 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a605008cb5474f168f572fd0a9e71193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634574e706ee4f31bf4446871f11d5e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:42:37.527565 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-5aeb266c-2955-4c0b-8539-56c4283ffcb1 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] 10.222.0.85 "GET /compute/v2.1/servers/ac2c33a4-21c2-47b7-9a97-7e3d49c3653a" status: 200 len: 1318 microversion: 2.1 time: 0.264620 Jun 07 14:42:37.528160 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 165/343] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:42:37 2022] GET /compute/v2.1/servers/ac2c33a4-21c2-47b7-9a97-7e3d49c3653a => generated 1318 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:42:38.454927 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-ac09c7b4-1284-4d84-82b9-b51528c7bdaf tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:42:38.454927 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-ac09c7b4-1284-4d84-82b9-b51528c7bdaf tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:42:38.459427 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-ac09c7b4-1284-4d84-82b9-b51528c7bdaf tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:42:38.459876 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-ac09c7b4-1284-4d84-82b9-b51528c7bdaf tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:42:38.460677 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-ac09c7b4-1284-4d84-82b9-b51528c7bdaf tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:42:38.461148 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-ac09c7b4-1284-4d84-82b9-b51528c7bdaf tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:42:38.487699 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-ac09c7b4-1284-4d84-82b9-b51528c7bdaf tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6/ips" status: 200 len: 147 microversion: 2.1 time: 0.039578 Jun 07 14:42:38.488466 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 179/344] 10.222.0.85 () {58 vars in 1247 bytes} [Tue Jun 7 14:42:38 2022] GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6/ips => generated 147 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:42:38.547051 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-25f77477-aa66-480e-a3a6-33b405a0c2ad tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:42:38.547783 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-25f77477-aa66-480e-a3a6-33b405a0c2ad tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] [instance: ac2c33a4-21c2-47b7-9a97-7e3d49c3653a] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:42:38.555639 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-25f77477-aa66-480e-a3a6-33b405a0c2ad tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:42:38.556086 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-25f77477-aa66-480e-a3a6-33b405a0c2ad tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:42:38.557953 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-25f77477-aa66-480e-a3a6-33b405a0c2ad tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:42:38.558434 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-25f77477-aa66-480e-a3a6-33b405a0c2ad tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:42:38.715283 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-25f77477-aa66-480e-a3a6-33b405a0c2ad tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a605008cb5474f168f572fd0a9e71193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634574e706ee4f31bf4446871f11d5e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:42:38.724664 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-25f77477-aa66-480e-a3a6-33b405a0c2ad tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] 10.222.0.85 "GET /compute/v2.1/servers/ac2c33a4-21c2-47b7-9a97-7e3d49c3653a" status: 200 len: 1318 microversion: 2.1 time: 0.183084 Jun 07 14:42:38.725210 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 166/345] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:42:38 2022] GET /compute/v2.1/servers/ac2c33a4-21c2-47b7-9a97-7e3d49c3653a => generated 1318 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:42:39.745668 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-e4c9ff14-9714-4a5b-8fb6-3f585e45f77a tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:42:39.746295 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-e4c9ff14-9714-4a5b-8fb6-3f585e45f77a tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] [instance: ac2c33a4-21c2-47b7-9a97-7e3d49c3653a] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:42:39.753153 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-e4c9ff14-9714-4a5b-8fb6-3f585e45f77a tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:42:39.753625 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-e4c9ff14-9714-4a5b-8fb6-3f585e45f77a tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:42:39.754422 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-e4c9ff14-9714-4a5b-8fb6-3f585e45f77a tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:42:39.754862 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-e4c9ff14-9714-4a5b-8fb6-3f585e45f77a tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:42:39.910699 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-e4c9ff14-9714-4a5b-8fb6-3f585e45f77a tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a605008cb5474f168f572fd0a9e71193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634574e706ee4f31bf4446871f11d5e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:42:39.919100 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-e4c9ff14-9714-4a5b-8fb6-3f585e45f77a tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] 10.222.0.85 "GET /compute/v2.1/servers/ac2c33a4-21c2-47b7-9a97-7e3d49c3653a" status: 200 len: 1318 microversion: 2.1 time: 0.177794 Jun 07 14:42:39.919619 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 180/346] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:42:39 2022] GET /compute/v2.1/servers/ac2c33a4-21c2-47b7-9a97-7e3d49c3653a => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:42:40.034781 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-ef8d6b0f-93fb-47d9-bd01-de175c6cac4f tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "833f78c8-54e1-460f-914b-b6b6b716612b"}} {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:42:40.037835 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-ef8d6b0f-93fb-47d9-bd01-de175c6cac4f tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 314a1177-9252-4a27-8c30-0b7af796d9a5] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:42:40.044878 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-ef8d6b0f-93fb-47d9-bd01-de175c6cac4f tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:42:40.045392 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-ef8d6b0f-93fb-47d9-bd01-de175c6cac4f tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:42:40.046351 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-ef8d6b0f-93fb-47d9-bd01-de175c6cac4f tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:42:40.048859 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-ef8d6b0f-93fb-47d9-bd01-de175c6cac4f tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:42:40.917517 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-ef8d6b0f-93fb-47d9-bd01-de175c6cac4f tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "POST /compute/v2.1/servers/314a1177-9252-4a27-8c30-0b7af796d9a5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.889575 Jun 07 14:42:40.918203 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 167/347] 10.222.0.85 () {60 vars in 1322 bytes} [Tue Jun 7 14:42:40 2022] POST /compute/v2.1/servers/314a1177-9252-4a27-8c30-0b7af796d9a5/os-volume_attachments => generated 194 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:42:40.941525 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-a9136958-ac18-414a-97f9-8d116d95aab6 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:42:40.941525 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-a9136958-ac18-414a-97f9-8d116d95aab6 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] [instance: ac2c33a4-21c2-47b7-9a97-7e3d49c3653a] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:42:40.953970 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-a9136958-ac18-414a-97f9-8d116d95aab6 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:42:40.954580 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-a9136958-ac18-414a-97f9-8d116d95aab6 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:42:40.955426 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-a9136958-ac18-414a-97f9-8d116d95aab6 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:42:40.955877 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-a9136958-ac18-414a-97f9-8d116d95aab6 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:42:41.106374 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-a9136958-ac18-414a-97f9-8d116d95aab6 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a605008cb5474f168f572fd0a9e71193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634574e706ee4f31bf4446871f11d5e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:42:41.113912 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-a9136958-ac18-414a-97f9-8d116d95aab6 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] 10.222.0.85 "GET /compute/v2.1/servers/ac2c33a4-21c2-47b7-9a97-7e3d49c3653a" status: 200 len: 1506 microversion: 2.1 time: 0.180364 Jun 07 14:42:41.114472 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 181/348] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:42:40 2022] GET /compute/v2.1/servers/ac2c33a4-21c2-47b7-9a97-7e3d49c3653a => generated 1506 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:42:42.923637 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-17067709-ea64-4d17-9382-8fdf9155f62b tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e06763a2-3cd2-4088-806b-e7c9c8bb300f"}} {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:42:42.924916 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-17067709-ea64-4d17-9382-8fdf9155f62b tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:42:42.931468 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-17067709-ea64-4d17-9382-8fdf9155f62b tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:42:42.931918 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-17067709-ea64-4d17-9382-8fdf9155f62b tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:42:42.933017 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-17067709-ea64-4d17-9382-8fdf9155f62b tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:42:42.933563 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-17067709-ea64-4d17-9382-8fdf9155f62b tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:42:43.711673 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-17067709-ea64-4d17-9382-8fdf9155f62b tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "POST /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.792239 Jun 07 14:42:43.712341 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 168/349] 10.222.0.85 () {60 vars in 1322 bytes} [Tue Jun 7 14:42:42 2022] POST /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6/os-volume_attachments => generated 194 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:42:49.506321 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-2267500c-0732-4136-afa5-035939b29c7d tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Action: 'create', calling method: .version_select at 0x7f5f88140940>, body: {"keypair": {"name": "tempest-keypair-28063091", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIqe9mgasW+8XMrVVO9HgQdbE1cumctxk2BevgMeTowLL1N600n4N3ub2/olex3VNV3Q3qWxWunHnq/KJc1X+e6/QEJ9zWYf9NRKD0EpuHXTfJXfeWaLIjYygHy8TlKpNw=="}} {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:42:49.522124 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.quota [None req-2267500c-0732-4136-afa5-035939b29c7d tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Getting quotas for project 8eae64ee53144e4f8d583bb4288c0aeb. Resources: {'key_pairs'} {{(pid=118158) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 14:42:49.525795 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.quota [None req-2267500c-0732-4136-afa5-035939b29c7d tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Getting quotas for user 34eb9ec1f3ff44bbb03cf934cb2a04de and project 8eae64ee53144e4f8d583bb4288c0aeb. Resources: {'key_pairs'} {{(pid=118158) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 14:42:49.621277 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-2267500c-0732-4136-afa5-035939b29c7d tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.118932 Jun 07 14:42:49.621866 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 182/350] 10.222.0.85 () {60 vars in 1158 bytes} [Tue Jun 7 14:42:49 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:42:52.234252 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG dbcounter [-] [118157] Writing DB stats nova_cell0:SELECT=10 {{(pid=118157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:42:52.242975 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-097e9c28-ea76-41a0-bf73-c695b651a09e tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-556766431", "imageRef": "7802ce25-d370-43a3-8d85-0257d644d539", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "52ef821c-7cda-47a1-a169-1a51a76fefad"}], "security_groups": [{"name": "tempest-securitygroup--109246710"}], "key_name": "tempest-keypair-28063091", "user_data": "}} {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:42:53.650769 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG dbcounter [-] [118157] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:42:55.281290 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.network.neutron [None req-097e9c28-ea76-41a0-bf73-c695b651a09e tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] validate_networks() for [('52ef821c-7cda-47a1-a169-1a51a76fefad', None, None, None, None, None)] {{(pid=118157) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 14:42:55.461881 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG dbcounter [-] [118157] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=4 {{(pid=118157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:42:55.664854 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.virt.hardware [None req-097e9c28-ea76-41a0-bf73-c695b651a09e tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Flavor limits 0:0:0 {{(pid=118157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 14:42:55.665279 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.virt.hardware [None req-097e9c28-ea76-41a0-bf73-c695b651a09e tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Image limits 0:0:0 {{(pid=118157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 14:42:55.665754 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.virt.hardware [None req-097e9c28-ea76-41a0-bf73-c695b651a09e tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Flavor pref 0:0:0 {{(pid=118157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 14:42:55.666185 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.virt.hardware [None req-097e9c28-ea76-41a0-bf73-c695b651a09e tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Image pref 0:0:0 {{(pid=118157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 14:42:55.666620 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.virt.hardware [None req-097e9c28-ea76-41a0-bf73-c695b651a09e tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 14:42:55.676414 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-097e9c28-ea76-41a0-bf73-c695b651a09e tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:42:55.676946 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-097e9c28-ea76-41a0-bf73-c695b651a09e tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:42:55.678402 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-097e9c28-ea76-41a0-bf73-c695b651a09e tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:42:55.678901 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-097e9c28-ea76-41a0-bf73-c695b651a09e tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:42:55.695731 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.quota [None req-097e9c28-ea76-41a0-bf73-c695b651a09e tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Getting quotas for project 8eae64ee53144e4f8d583bb4288c0aeb. Resources: {'instances', 'cores', 'ram'} {{(pid=118157) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 14:42:55.700740 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.quota [None req-097e9c28-ea76-41a0-bf73-c695b651a09e tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Getting quotas for user 34eb9ec1f3ff44bbb03cf934cb2a04de and project 8eae64ee53144e4f8d583bb4288c0aeb. Resources: {'instances', 'cores', 'ram'} {{(pid=118157) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 14:42:55.710940 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-097e9c28-ea76-41a0-bf73-c695b651a09e tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Going to run 1 instances... {{(pid=118157) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 14:42:55.713910 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-097e9c28-ea76-41a0-bf73-c695b651a09e tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: a06b2dd5-e4da-4f12-ba52-40a6527f8d60] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7802ce25-d370-43a3-8d85-0257d644d539',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118157) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 14:42:55.860533 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-097e9c28-ea76-41a0-bf73-c695b651a09e tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.631081 Jun 07 14:42:55.861189 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 169/351] 10.222.0.85 () {60 vars in 1146 bytes} [Tue Jun 7 14:42:52 2022] POST /compute/v2.1/servers => generated 401 bytes in 3633 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 14:42:55.871300 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG dbcounter [-] [118158] Writing DB stats nova_cell1:SELECT=46 {{(pid=118158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:42:55.875352 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-207772f7-0935-45aa-890f-d9c1df71901a tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:42:55.876128 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-207772f7-0935-45aa-890f-d9c1df71901a tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: a06b2dd5-e4da-4f12-ba52-40a6527f8d60] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:42:55.939944 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-207772f7-0935-45aa-890f-d9c1df71901a tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eb9ec1f3ff44bbb03cf934cb2a04de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eae64ee53144e4f8d583bb4288c0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:42:55.946780 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-207772f7-0935-45aa-890f-d9c1df71901a tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/a06b2dd5-e4da-4f12-ba52-40a6527f8d60" status: 200 len: 1239 microversion: 2.1 time: 0.076299 Jun 07 14:42:55.947893 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 183/352] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:42:55 2022] GET /compute/v2.1/servers/a06b2dd5-e4da-4f12-ba52-40a6527f8d60 => generated 1239 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:42:56.965554 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-633ef636-ad5b-428d-9389-aab178c5abeb tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:42:56.966152 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-633ef636-ad5b-428d-9389-aab178c5abeb tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: a06b2dd5-e4da-4f12-ba52-40a6527f8d60] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:42:56.973529 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-633ef636-ad5b-428d-9389-aab178c5abeb tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:42:56.974011 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-633ef636-ad5b-428d-9389-aab178c5abeb tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:42:56.974786 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-633ef636-ad5b-428d-9389-aab178c5abeb tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:42:56.975284 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-633ef636-ad5b-428d-9389-aab178c5abeb tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:42:57.048235 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-633ef636-ad5b-428d-9389-aab178c5abeb tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eb9ec1f3ff44bbb03cf934cb2a04de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eae64ee53144e4f8d583bb4288c0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:42:57.056400 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-633ef636-ad5b-428d-9389-aab178c5abeb tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/a06b2dd5-e4da-4f12-ba52-40a6527f8d60" status: 200 len: 1243 microversion: 2.1 time: 0.095756 Jun 07 14:42:57.057163 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 170/353] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:42:56 2022] GET /compute/v2.1/servers/a06b2dd5-e4da-4f12-ba52-40a6527f8d60 => generated 1243 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:42:57.585161 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-c0df2207-ce46-4622-aec5-906209793db6 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:42:57.587080 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG dbcounter [-] [118158] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=118158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:42:57.592887 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-c0df2207-ce46-4622-aec5-906209793db6 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:42:57.596239 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-c0df2207-ce46-4622-aec5-906209793db6 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:42:57.654343 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-c0df2207-ce46-4622-aec5-906209793db6 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6] Going to try to stop instance {{(pid=118158) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 07 14:42:57.903934 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-c0df2207-ce46-4622-aec5-906209793db6 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "POST /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6/action" status: 202 len: 0 microversion: 2.1 time: 0.322548 Jun 07 14:42:57.904601 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 184/354] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Jun 7 14:42:57 2022] POST /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6/action => generated 0 bytes in 324 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 14:42:57.912640 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-0d208177-bd22-4b24-b89b-fb44cdf3409a tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:42:57.913252 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-0d208177-bd22-4b24-b89b-fb44cdf3409a tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:42:57.920101 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-0d208177-bd22-4b24-b89b-fb44cdf3409a tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:42:57.920738 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-0d208177-bd22-4b24-b89b-fb44cdf3409a tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:42:57.921508 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-0d208177-bd22-4b24-b89b-fb44cdf3409a tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:42:57.921945 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-0d208177-bd22-4b24-b89b-fb44cdf3409a tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:42:58.075754 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-03dbb964-dbc1-4c0e-8a30-1c182d8a26a7 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:42:58.076639 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-03dbb964-dbc1-4c0e-8a30-1c182d8a26a7 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: a06b2dd5-e4da-4f12-ba52-40a6527f8d60] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:42:58.082859 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-03dbb964-dbc1-4c0e-8a30-1c182d8a26a7 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:42:58.083393 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-03dbb964-dbc1-4c0e-8a30-1c182d8a26a7 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:42:58.084238 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-03dbb964-dbc1-4c0e-8a30-1c182d8a26a7 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:42:58.084788 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-03dbb964-dbc1-4c0e-8a30-1c182d8a26a7 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:42:58.146345 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-0d208177-bd22-4b24-b89b-fb44cdf3409a tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb4b0cf5f8b4274b787f327793964f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ba26b86c7243dab8e6c6b84ed674e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:42:58.151743 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-03dbb964-dbc1-4c0e-8a30-1c182d8a26a7 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eb9ec1f3ff44bbb03cf934cb2a04de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eae64ee53144e4f8d583bb4288c0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:42:58.157593 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-0d208177-bd22-4b24-b89b-fb44cdf3409a tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6" status: 200 len: 1725 microversion: 2.1 time: 0.248631 Jun 07 14:42:58.158105 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 171/355] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:42:57 2022] GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 => generated 1725 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:42:58.168706 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-03dbb964-dbc1-4c0e-8a30-1c182d8a26a7 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/a06b2dd5-e4da-4f12-ba52-40a6527f8d60" status: 200 len: 1299 microversion: 2.1 time: 0.087698 Jun 07 14:42:58.168706 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 185/356] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:42:58 2022] GET /compute/v2.1/servers/a06b2dd5-e4da-4f12-ba52-40a6527f8d60 => generated 1299 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:42:59.176126 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-892b6dca-ba04-4ee2-b852-99fa8788b83c tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:42:59.176774 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-892b6dca-ba04-4ee2-b852-99fa8788b83c tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:42:59.181240 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-328aad16-cd22-4232-b481-9978dd3f13bb tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:42:59.182065 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-328aad16-cd22-4232-b481-9978dd3f13bb tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: a06b2dd5-e4da-4f12-ba52-40a6527f8d60] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:42:59.183659 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-892b6dca-ba04-4ee2-b852-99fa8788b83c tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:42:59.184297 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-892b6dca-ba04-4ee2-b852-99fa8788b83c tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:42:59.185132 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-892b6dca-ba04-4ee2-b852-99fa8788b83c tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:42:59.185650 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-892b6dca-ba04-4ee2-b852-99fa8788b83c tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:42:59.188771 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-328aad16-cd22-4232-b481-9978dd3f13bb tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:42:59.189298 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-328aad16-cd22-4232-b481-9978dd3f13bb tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:42:59.190250 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-328aad16-cd22-4232-b481-9978dd3f13bb tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:42:59.190695 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-328aad16-cd22-4232-b481-9978dd3f13bb tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:42:59.353242 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-328aad16-cd22-4232-b481-9978dd3f13bb tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eb9ec1f3ff44bbb03cf934cb2a04de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eae64ee53144e4f8d583bb4288c0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:42:59.360929 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-328aad16-cd22-4232-b481-9978dd3f13bb tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/a06b2dd5-e4da-4f12-ba52-40a6527f8d60" status: 200 len: 1364 microversion: 2.1 time: 0.183790 Jun 07 14:42:59.361592 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 186/357] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:42:59 2022] GET /compute/v2.1/servers/a06b2dd5-e4da-4f12-ba52-40a6527f8d60 => generated 1364 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:42:59.440869 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-892b6dca-ba04-4ee2-b852-99fa8788b83c tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb4b0cf5f8b4274b787f327793964f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ba26b86c7243dab8e6c6b84ed674e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:42:59.449492 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-892b6dca-ba04-4ee2-b852-99fa8788b83c tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6" status: 200 len: 1725 microversion: 2.1 time: 0.277177 Jun 07 14:42:59.450059 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 172/358] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:42:59 2022] GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 => generated 1725 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:43:00.056633 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [req-7ae5466d-875a-4347-bddd-0f221eec752e req-f6db1a7d-8a7e-4358-8c62-37078f1f74d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a06b2dd5-e4da-4f12-ba52-40a6527f8d60", "tag": "9131e5ca-5201-41c7-94aa-a5c0e37a07f7"}]} {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:43:00.066572 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [req-7ae5466d-875a-4347-bddd-0f221eec752e req-f6db1a7d-8a7e-4358-8c62-37078f1f74d2 service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:00.067016 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [req-7ae5466d-875a-4347-bddd-0f221eec752e req-f6db1a7d-8a7e-4358-8c62-37078f1f74d2 service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:00.079461 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.compute.server_external_events [req-7ae5466d-875a-4347-bddd-0f221eec752e req-f6db1a7d-8a7e-4358-8c62-37078f1f74d2 service nova] Creating event network-changed:9131e5ca-5201-41c7-94aa-a5c0e37a07f7 for instance a06b2dd5-e4da-4f12-ba52-40a6527f8d60 on hv-cinder-84497 Jun 07 14:43:00.084237 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [req-7ae5466d-875a-4347-bddd-0f221eec752e req-f6db1a7d-8a7e-4358-8c62-37078f1f74d2 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031395 Jun 07 14:43:00.085171 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 187/359] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jun 7 14:43:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:43:00.377516 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-d5697f23-7b3a-4c3f-b77a-4a0023fe3e61 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:43:00.378071 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-d5697f23-7b3a-4c3f-b77a-4a0023fe3e61 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: a06b2dd5-e4da-4f12-ba52-40a6527f8d60] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:43:00.384547 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-d5697f23-7b3a-4c3f-b77a-4a0023fe3e61 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:00.385005 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-d5697f23-7b3a-4c3f-b77a-4a0023fe3e61 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:00.385769 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-d5697f23-7b3a-4c3f-b77a-4a0023fe3e61 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:00.386207 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-d5697f23-7b3a-4c3f-b77a-4a0023fe3e61 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:00.467872 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-4019256d-7706-4517-8882-f978bcbcfddb tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:43:00.469094 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-4019256d-7706-4517-8882-f978bcbcfddb tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:43:00.476132 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-4019256d-7706-4517-8882-f978bcbcfddb tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:00.476616 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-4019256d-7706-4517-8882-f978bcbcfddb tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:00.477397 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-4019256d-7706-4517-8882-f978bcbcfddb tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:00.477940 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-4019256d-7706-4517-8882-f978bcbcfddb tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:00.565222 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-d5697f23-7b3a-4c3f-b77a-4a0023fe3e61 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eb9ec1f3ff44bbb03cf934cb2a04de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eae64ee53144e4f8d583bb4288c0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:00.573205 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-d5697f23-7b3a-4c3f-b77a-4a0023fe3e61 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/a06b2dd5-e4da-4f12-ba52-40a6527f8d60" status: 200 len: 1364 microversion: 2.1 time: 0.199474 Jun 07 14:43:00.582989 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 173/360] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:43:00 2022] GET /compute/v2.1/servers/a06b2dd5-e4da-4f12-ba52-40a6527f8d60 => generated 1364 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:43:00.627010 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-4019256d-7706-4517-8882-f978bcbcfddb tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb4b0cf5f8b4274b787f327793964f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ba26b86c7243dab8e6c6b84ed674e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:00.635984 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-4019256d-7706-4517-8882-f978bcbcfddb tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6" status: 200 len: 1725 microversion: 2.1 time: 0.172075 Jun 07 14:43:00.636519 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 188/361] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:43:00 2022] GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 => generated 1725 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:43:01.590236 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-95ee4eec-085b-4b13-8920-c45e9ab11255 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:43:01.590851 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-95ee4eec-085b-4b13-8920-c45e9ab11255 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: a06b2dd5-e4da-4f12-ba52-40a6527f8d60] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:43:01.597300 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-95ee4eec-085b-4b13-8920-c45e9ab11255 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:01.597753 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-95ee4eec-085b-4b13-8920-c45e9ab11255 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:01.598516 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-95ee4eec-085b-4b13-8920-c45e9ab11255 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:01.598957 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-95ee4eec-085b-4b13-8920-c45e9ab11255 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:01.655381 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-85cb84f0-7680-4569-a643-f21b83fbdfcd tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:43:01.656552 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-85cb84f0-7680-4569-a643-f21b83fbdfcd tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:43:01.662901 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-85cb84f0-7680-4569-a643-f21b83fbdfcd tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:01.663354 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-85cb84f0-7680-4569-a643-f21b83fbdfcd tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:01.664139 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-85cb84f0-7680-4569-a643-f21b83fbdfcd tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:01.664612 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-85cb84f0-7680-4569-a643-f21b83fbdfcd tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:01.740976 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-95ee4eec-085b-4b13-8920-c45e9ab11255 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eb9ec1f3ff44bbb03cf934cb2a04de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eae64ee53144e4f8d583bb4288c0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:01.754938 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-95ee4eec-085b-4b13-8920-c45e9ab11255 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/a06b2dd5-e4da-4f12-ba52-40a6527f8d60" status: 200 len: 1364 microversion: 2.1 time: 0.168117 Jun 07 14:43:01.755950 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 174/362] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:43:01 2022] GET /compute/v2.1/servers/a06b2dd5-e4da-4f12-ba52-40a6527f8d60 => generated 1364 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:43:01.811098 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-85cb84f0-7680-4569-a643-f21b83fbdfcd tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb4b0cf5f8b4274b787f327793964f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ba26b86c7243dab8e6c6b84ed674e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:01.818996 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-85cb84f0-7680-4569-a643-f21b83fbdfcd tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6" status: 200 len: 1725 microversion: 2.1 time: 0.169320 Jun 07 14:43:01.819547 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 189/363] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:43:01 2022] GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 => generated 1725 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:43:02.773261 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-735d088f-6f71-4a96-90d0-b83f4ee3c156 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:43:02.773831 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-735d088f-6f71-4a96-90d0-b83f4ee3c156 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: a06b2dd5-e4da-4f12-ba52-40a6527f8d60] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:43:02.779903 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-735d088f-6f71-4a96-90d0-b83f4ee3c156 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:02.780349 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-735d088f-6f71-4a96-90d0-b83f4ee3c156 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:02.781145 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-735d088f-6f71-4a96-90d0-b83f4ee3c156 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:02.781581 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-735d088f-6f71-4a96-90d0-b83f4ee3c156 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:02.835606 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-ed56ee99-cae2-4faf-97a9-483dca5e761c tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:43:02.836218 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-ed56ee99-cae2-4faf-97a9-483dca5e761c tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:43:02.842191 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-ed56ee99-cae2-4faf-97a9-483dca5e761c tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:02.842638 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-ed56ee99-cae2-4faf-97a9-483dca5e761c tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:02.843406 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-ed56ee99-cae2-4faf-97a9-483dca5e761c tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:02.843867 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-ed56ee99-cae2-4faf-97a9-483dca5e761c tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:02.910955 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-735d088f-6f71-4a96-90d0-b83f4ee3c156 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eb9ec1f3ff44bbb03cf934cb2a04de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eae64ee53144e4f8d583bb4288c0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:02.919734 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-735d088f-6f71-4a96-90d0-b83f4ee3c156 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/a06b2dd5-e4da-4f12-ba52-40a6527f8d60" status: 200 len: 1364 microversion: 2.1 time: 0.150726 Jun 07 14:43:02.924414 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 175/364] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:43:02 2022] GET /compute/v2.1/servers/a06b2dd5-e4da-4f12-ba52-40a6527f8d60 => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:43:02.982003 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-ed56ee99-cae2-4faf-97a9-483dca5e761c tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb4b0cf5f8b4274b787f327793964f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ba26b86c7243dab8e6c6b84ed674e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:02.990153 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-ed56ee99-cae2-4faf-97a9-483dca5e761c tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6" status: 200 len: 1725 microversion: 2.1 time: 0.158349 Jun 07 14:43:02.990733 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 190/365] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:43:02 2022] GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:43:03.937261 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-8e98e545-3e97-4b3a-abf6-3eb08e752376 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:43:03.937888 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-8e98e545-3e97-4b3a-abf6-3eb08e752376 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: a06b2dd5-e4da-4f12-ba52-40a6527f8d60] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:43:03.949499 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-8e98e545-3e97-4b3a-abf6-3eb08e752376 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:03.949955 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-8e98e545-3e97-4b3a-abf6-3eb08e752376 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:03.955086 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-8e98e545-3e97-4b3a-abf6-3eb08e752376 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:03.955086 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-8e98e545-3e97-4b3a-abf6-3eb08e752376 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:04.008334 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-64086d49-115d-472c-8375-d9647e5e8893 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:43:04.010100 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-64086d49-115d-472c-8375-d9647e5e8893 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:43:04.024180 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-64086d49-115d-472c-8375-d9647e5e8893 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:04.024180 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-64086d49-115d-472c-8375-d9647e5e8893 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:04.024180 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-64086d49-115d-472c-8375-d9647e5e8893 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:04.024180 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-64086d49-115d-472c-8375-d9647e5e8893 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:04.111673 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-8e98e545-3e97-4b3a-abf6-3eb08e752376 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eb9ec1f3ff44bbb03cf934cb2a04de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eae64ee53144e4f8d583bb4288c0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:04.120890 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-8e98e545-3e97-4b3a-abf6-3eb08e752376 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/a06b2dd5-e4da-4f12-ba52-40a6527f8d60" status: 200 len: 1364 microversion: 2.1 time: 0.187417 Jun 07 14:43:04.121506 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 176/366] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:43:03 2022] GET /compute/v2.1/servers/a06b2dd5-e4da-4f12-ba52-40a6527f8d60 => generated 1364 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:43:04.166438 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-64086d49-115d-472c-8375-d9647e5e8893 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb4b0cf5f8b4274b787f327793964f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ba26b86c7243dab8e6c6b84ed674e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:04.174606 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-64086d49-115d-472c-8375-d9647e5e8893 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6" status: 200 len: 1725 microversion: 2.1 time: 0.171525 Jun 07 14:43:04.175168 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 191/367] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:43:04 2022] GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 => generated 1725 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:43:05.138211 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-03ab7111-9f3f-4b74-9c70-4a09dd8171c0 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:43:05.138834 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-03ab7111-9f3f-4b74-9c70-4a09dd8171c0 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: a06b2dd5-e4da-4f12-ba52-40a6527f8d60] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:43:05.145604 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-03ab7111-9f3f-4b74-9c70-4a09dd8171c0 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:05.146050 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-03ab7111-9f3f-4b74-9c70-4a09dd8171c0 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:05.146805 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-03ab7111-9f3f-4b74-9c70-4a09dd8171c0 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:05.147229 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-03ab7111-9f3f-4b74-9c70-4a09dd8171c0 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:05.193850 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-f2543a50-e58a-47c2-9f4b-8362da5d38af tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:43:05.194471 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-f2543a50-e58a-47c2-9f4b-8362da5d38af tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:43:05.201796 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-f2543a50-e58a-47c2-9f4b-8362da5d38af tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:05.202260 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-f2543a50-e58a-47c2-9f4b-8362da5d38af tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:05.203034 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-f2543a50-e58a-47c2-9f4b-8362da5d38af tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:05.203529 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-f2543a50-e58a-47c2-9f4b-8362da5d38af tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:05.288767 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-03ab7111-9f3f-4b74-9c70-4a09dd8171c0 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eb9ec1f3ff44bbb03cf934cb2a04de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eae64ee53144e4f8d583bb4288c0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:05.296672 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-03ab7111-9f3f-4b74-9c70-4a09dd8171c0 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/a06b2dd5-e4da-4f12-ba52-40a6527f8d60" status: 200 len: 1364 microversion: 2.1 time: 0.162744 Jun 07 14:43:05.297238 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 177/368] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:43:05 2022] GET /compute/v2.1/servers/a06b2dd5-e4da-4f12-ba52-40a6527f8d60 => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:43:05.340410 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-f2543a50-e58a-47c2-9f4b-8362da5d38af tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb4b0cf5f8b4274b787f327793964f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ba26b86c7243dab8e6c6b84ed674e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:05.348631 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-f2543a50-e58a-47c2-9f4b-8362da5d38af tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6" status: 200 len: 1725 microversion: 2.1 time: 0.158770 Jun 07 14:43:05.349203 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 192/369] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:43:05 2022] GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:43:06.316996 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-aa2ae317-595d-4e50-9073-73cd98cc8350 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:43:06.317606 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-aa2ae317-595d-4e50-9073-73cd98cc8350 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: a06b2dd5-e4da-4f12-ba52-40a6527f8d60] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:43:06.319427 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG dbcounter [-] [118157] Writing DB stats nova_cell0:SELECT=2 {{(pid=118157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:43:06.320084 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG dbcounter [-] [118157] Writing DB stats nova_cell0:SELECT=6 {{(pid=118157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:43:06.325380 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-aa2ae317-595d-4e50-9073-73cd98cc8350 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:06.325823 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-aa2ae317-595d-4e50-9073-73cd98cc8350 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:06.326573 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-aa2ae317-595d-4e50-9073-73cd98cc8350 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:06.327003 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-aa2ae317-595d-4e50-9073-73cd98cc8350 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:06.364579 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-12a6fb4e-4488-4d69-8b37-759203b8cae0 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:43:06.365239 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-12a6fb4e-4488-4d69-8b37-759203b8cae0 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:43:06.368089 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG dbcounter [-] [118158] Writing DB stats nova_cell0:SELECT=6 {{(pid=118158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:43:06.372434 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-12a6fb4e-4488-4d69-8b37-759203b8cae0 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:06.372908 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-12a6fb4e-4488-4d69-8b37-759203b8cae0 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:06.373682 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-12a6fb4e-4488-4d69-8b37-759203b8cae0 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:06.374110 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-12a6fb4e-4488-4d69-8b37-759203b8cae0 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:06.457876 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-aa2ae317-595d-4e50-9073-73cd98cc8350 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eb9ec1f3ff44bbb03cf934cb2a04de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eae64ee53144e4f8d583bb4288c0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:06.466490 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-aa2ae317-595d-4e50-9073-73cd98cc8350 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/a06b2dd5-e4da-4f12-ba52-40a6527f8d60" status: 200 len: 1364 microversion: 2.1 time: 0.153152 Jun 07 14:43:06.467055 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 178/370] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:43:06 2022] GET /compute/v2.1/servers/a06b2dd5-e4da-4f12-ba52-40a6527f8d60 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:43:06.502790 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-12a6fb4e-4488-4d69-8b37-759203b8cae0 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb4b0cf5f8b4274b787f327793964f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ba26b86c7243dab8e6c6b84ed674e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:06.510584 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-12a6fb4e-4488-4d69-8b37-759203b8cae0 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6" status: 200 len: 1725 microversion: 2.1 time: 0.149786 Jun 07 14:43:06.511125 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 193/371] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:43:06 2022] GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:43:07.483884 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-6f6136a3-e285-4874-9cb3-ebe7cc4113df tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:43:07.484525 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-6f6136a3-e285-4874-9cb3-ebe7cc4113df tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: a06b2dd5-e4da-4f12-ba52-40a6527f8d60] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:43:07.490931 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-6f6136a3-e285-4874-9cb3-ebe7cc4113df tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:07.491368 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-6f6136a3-e285-4874-9cb3-ebe7cc4113df tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:07.492119 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-6f6136a3-e285-4874-9cb3-ebe7cc4113df tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:07.492587 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-6f6136a3-e285-4874-9cb3-ebe7cc4113df tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:07.527170 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-e6af90b6-dfb9-4e35-a28c-1d5f00df096f tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:43:07.527851 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-e6af90b6-dfb9-4e35-a28c-1d5f00df096f tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:43:07.533925 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-e6af90b6-dfb9-4e35-a28c-1d5f00df096f tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:07.534377 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-e6af90b6-dfb9-4e35-a28c-1d5f00df096f tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:07.535150 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-e6af90b6-dfb9-4e35-a28c-1d5f00df096f tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:07.535588 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-e6af90b6-dfb9-4e35-a28c-1d5f00df096f tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:07.626815 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-6f6136a3-e285-4874-9cb3-ebe7cc4113df tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eb9ec1f3ff44bbb03cf934cb2a04de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eae64ee53144e4f8d583bb4288c0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:07.634555 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-6f6136a3-e285-4874-9cb3-ebe7cc4113df tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/a06b2dd5-e4da-4f12-ba52-40a6527f8d60" status: 200 len: 1364 microversion: 2.1 time: 0.154484 Jun 07 14:43:07.635919 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 179/372] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:43:07 2022] GET /compute/v2.1/servers/a06b2dd5-e4da-4f12-ba52-40a6527f8d60 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:43:07.671677 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-e6af90b6-dfb9-4e35-a28c-1d5f00df096f tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb4b0cf5f8b4274b787f327793964f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ba26b86c7243dab8e6c6b84ed674e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:07.679948 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-e6af90b6-dfb9-4e35-a28c-1d5f00df096f tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6" status: 200 len: 1725 microversion: 2.1 time: 0.156562 Jun 07 14:43:07.680542 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 194/373] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:43:07 2022] GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:43:08.652298 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-f30a974c-7479-48e9-a678-9d032b28bbf8 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:43:08.653004 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-f30a974c-7479-48e9-a678-9d032b28bbf8 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: a06b2dd5-e4da-4f12-ba52-40a6527f8d60] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:43:08.659454 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-f30a974c-7479-48e9-a678-9d032b28bbf8 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:08.659910 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-f30a974c-7479-48e9-a678-9d032b28bbf8 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:08.660730 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-f30a974c-7479-48e9-a678-9d032b28bbf8 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:08.661179 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-f30a974c-7479-48e9-a678-9d032b28bbf8 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:08.697489 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-5157991d-cb5f-40d1-a2d5-cb4955f59e44 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:43:08.701365 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-5157991d-cb5f-40d1-a2d5-cb4955f59e44 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:43:08.704957 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5157991d-cb5f-40d1-a2d5-cb4955f59e44 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:08.705472 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5157991d-cb5f-40d1-a2d5-cb4955f59e44 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:08.706321 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5157991d-cb5f-40d1-a2d5-cb4955f59e44 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:08.706822 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5157991d-cb5f-40d1-a2d5-cb4955f59e44 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:08.790632 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-f30a974c-7479-48e9-a678-9d032b28bbf8 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eb9ec1f3ff44bbb03cf934cb2a04de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eae64ee53144e4f8d583bb4288c0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:08.798142 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-f30a974c-7479-48e9-a678-9d032b28bbf8 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/a06b2dd5-e4da-4f12-ba52-40a6527f8d60" status: 200 len: 1364 microversion: 2.1 time: 0.149710 Jun 07 14:43:08.798710 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 180/374] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:43:08 2022] GET /compute/v2.1/servers/a06b2dd5-e4da-4f12-ba52-40a6527f8d60 => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:43:08.838659 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-5157991d-cb5f-40d1-a2d5-cb4955f59e44 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb4b0cf5f8b4274b787f327793964f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ba26b86c7243dab8e6c6b84ed674e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:08.846570 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-5157991d-cb5f-40d1-a2d5-cb4955f59e44 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6" status: 200 len: 1725 microversion: 2.1 time: 0.153391 Jun 07 14:43:08.847128 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 195/375] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:43:08 2022] GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:43:09.438765 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [req-e0df6a94-d00d-4f56-b023-091b5e0bb5d3 req-eef09bb3-b91a-4ee7-912f-a20bd38454e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a06b2dd5-e4da-4f12-ba52-40a6527f8d60", "name": "network-vif-plugged", "status": "completed", "tag": "9131e5ca-5201-41c7-94aa-a5c0e37a07f7"}]} {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:43:09.447262 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [req-e0df6a94-d00d-4f56-b023-091b5e0bb5d3 req-eef09bb3-b91a-4ee7-912f-a20bd38454e0 service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:09.448332 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [req-e0df6a94-d00d-4f56-b023-091b5e0bb5d3 req-eef09bb3-b91a-4ee7-912f-a20bd38454e0 service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:09.459039 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.compute.server_external_events [req-e0df6a94-d00d-4f56-b023-091b5e0bb5d3 req-eef09bb3-b91a-4ee7-912f-a20bd38454e0 service nova] Creating event network-vif-plugged:9131e5ca-5201-41c7-94aa-a5c0e37a07f7 for instance a06b2dd5-e4da-4f12-ba52-40a6527f8d60 on hv-cinder-84497 Jun 07 14:43:09.464038 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [req-e0df6a94-d00d-4f56-b023-091b5e0bb5d3 req-eef09bb3-b91a-4ee7-912f-a20bd38454e0 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028933 Jun 07 14:43:09.464654 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 181/376] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jun 7 14:43:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:43:09.815010 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-69e9bf83-869b-4c31-84cd-1e31bf72a145 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:43:09.815727 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-69e9bf83-869b-4c31-84cd-1e31bf72a145 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: a06b2dd5-e4da-4f12-ba52-40a6527f8d60] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:43:09.821870 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-69e9bf83-869b-4c31-84cd-1e31bf72a145 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:09.822326 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-69e9bf83-869b-4c31-84cd-1e31bf72a145 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:09.823950 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-69e9bf83-869b-4c31-84cd-1e31bf72a145 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:09.824096 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-69e9bf83-869b-4c31-84cd-1e31bf72a145 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:09.864263 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-f5c5f596-bbb3-4a81-8a55-51916ed31791 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:43:09.866194 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-f5c5f596-bbb3-4a81-8a55-51916ed31791 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:43:09.876780 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-f5c5f596-bbb3-4a81-8a55-51916ed31791 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:09.877375 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-f5c5f596-bbb3-4a81-8a55-51916ed31791 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:09.878655 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-f5c5f596-bbb3-4a81-8a55-51916ed31791 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:09.879100 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-f5c5f596-bbb3-4a81-8a55-51916ed31791 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:09.976708 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-69e9bf83-869b-4c31-84cd-1e31bf72a145 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eb9ec1f3ff44bbb03cf934cb2a04de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eae64ee53144e4f8d583bb4288c0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:09.984901 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-69e9bf83-869b-4c31-84cd-1e31bf72a145 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/a06b2dd5-e4da-4f12-ba52-40a6527f8d60" status: 200 len: 1364 microversion: 2.1 time: 0.173632 Jun 07 14:43:09.985476 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 196/377] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:43:09 2022] GET /compute/v2.1/servers/a06b2dd5-e4da-4f12-ba52-40a6527f8d60 => generated 1364 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:43:10.021364 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-f5c5f596-bbb3-4a81-8a55-51916ed31791 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb4b0cf5f8b4274b787f327793964f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ba26b86c7243dab8e6c6b84ed674e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:10.028798 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-f5c5f596-bbb3-4a81-8a55-51916ed31791 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6" status: 200 len: 1725 microversion: 2.1 time: 0.169473 Jun 07 14:43:10.029356 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 182/378] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:43:09 2022] GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 => generated 1725 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:43:11.004606 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-4cfa47ee-2bed-447f-a774-527d50559fa4 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:43:11.005144 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-4cfa47ee-2bed-447f-a774-527d50559fa4 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: a06b2dd5-e4da-4f12-ba52-40a6527f8d60] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:43:11.011227 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-4cfa47ee-2bed-447f-a774-527d50559fa4 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:11.011679 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-4cfa47ee-2bed-447f-a774-527d50559fa4 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:11.012479 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-4cfa47ee-2bed-447f-a774-527d50559fa4 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:11.012917 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-4cfa47ee-2bed-447f-a774-527d50559fa4 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:11.047108 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-38523b39-16e4-4388-a3d7-63f7892abe1b tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:43:11.047714 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-38523b39-16e4-4388-a3d7-63f7892abe1b tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:43:11.066610 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-38523b39-16e4-4388-a3d7-63f7892abe1b tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:11.067373 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-38523b39-16e4-4388-a3d7-63f7892abe1b tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:11.068711 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-38523b39-16e4-4388-a3d7-63f7892abe1b tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:11.069452 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-38523b39-16e4-4388-a3d7-63f7892abe1b tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:11.150910 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-4cfa47ee-2bed-447f-a774-527d50559fa4 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eb9ec1f3ff44bbb03cf934cb2a04de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eae64ee53144e4f8d583bb4288c0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:11.158483 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-4cfa47ee-2bed-447f-a774-527d50559fa4 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/a06b2dd5-e4da-4f12-ba52-40a6527f8d60" status: 200 len: 1364 microversion: 2.1 time: 0.157730 Jun 07 14:43:11.158868 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 197/379] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:43:10 2022] GET /compute/v2.1/servers/a06b2dd5-e4da-4f12-ba52-40a6527f8d60 => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:43:11.210355 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-38523b39-16e4-4388-a3d7-63f7892abe1b tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb4b0cf5f8b4274b787f327793964f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ba26b86c7243dab8e6c6b84ed674e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:11.218339 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-38523b39-16e4-4388-a3d7-63f7892abe1b tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6" status: 200 len: 1725 microversion: 2.1 time: 0.175152 Jun 07 14:43:11.218893 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 183/380] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:43:11 2022] GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 => generated 1725 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:43:12.175514 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-6e2d28a0-f24f-4228-abb1-b3eb48222655 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:43:12.176053 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-6e2d28a0-f24f-4228-abb1-b3eb48222655 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: a06b2dd5-e4da-4f12-ba52-40a6527f8d60] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:43:12.182931 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-6e2d28a0-f24f-4228-abb1-b3eb48222655 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:12.183387 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-6e2d28a0-f24f-4228-abb1-b3eb48222655 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:12.184169 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-6e2d28a0-f24f-4228-abb1-b3eb48222655 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:12.184638 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-6e2d28a0-f24f-4228-abb1-b3eb48222655 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:12.235633 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-55a839cb-27ac-4695-87bc-afdaa6e17a5f tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:43:12.236245 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-55a839cb-27ac-4695-87bc-afdaa6e17a5f tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:43:12.242838 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-55a839cb-27ac-4695-87bc-afdaa6e17a5f tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:12.243288 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-55a839cb-27ac-4695-87bc-afdaa6e17a5f tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:12.244053 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-55a839cb-27ac-4695-87bc-afdaa6e17a5f tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:12.245099 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-55a839cb-27ac-4695-87bc-afdaa6e17a5f tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:12.314013 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-6e2d28a0-f24f-4228-abb1-b3eb48222655 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eb9ec1f3ff44bbb03cf934cb2a04de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eae64ee53144e4f8d583bb4288c0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:12.321586 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-6e2d28a0-f24f-4228-abb1-b3eb48222655 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/a06b2dd5-e4da-4f12-ba52-40a6527f8d60" status: 200 len: 1554 microversion: 2.1 time: 0.149991 Jun 07 14:43:12.322154 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 198/381] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:43:12 2022] GET /compute/v2.1/servers/a06b2dd5-e4da-4f12-ba52-40a6527f8d60 => generated 1554 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:43:12.338753 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-b41321d1-bb38-48dd-ad2d-d4a876626fce tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:43:12.339507 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-b41321d1-bb38-48dd-ad2d-d4a876626fce tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: a06b2dd5-e4da-4f12-ba52-40a6527f8d60] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:43:12.345610 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-b41321d1-bb38-48dd-ad2d-d4a876626fce tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:12.346064 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-b41321d1-bb38-48dd-ad2d-d4a876626fce tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:12.346842 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-b41321d1-bb38-48dd-ad2d-d4a876626fce tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:12.347285 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-b41321d1-bb38-48dd-ad2d-d4a876626fce tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:12.383562 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-55a839cb-27ac-4695-87bc-afdaa6e17a5f tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb4b0cf5f8b4274b787f327793964f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ba26b86c7243dab8e6c6b84ed674e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:12.391580 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-55a839cb-27ac-4695-87bc-afdaa6e17a5f tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6" status: 200 len: 1725 microversion: 2.1 time: 0.159797 Jun 07 14:43:12.392619 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 184/382] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:43:12 2022] GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:43:12.429194 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-b41321d1-bb38-48dd-ad2d-d4a876626fce tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/a06b2dd5-e4da-4f12-ba52-40a6527f8d60/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094729 Jun 07 14:43:12.436477 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 199/383] 10.222.0.85 () {58 vars in 1274 bytes} [Tue Jun 7 14:43:12 2022] GET /compute/v2.1/servers/a06b2dd5-e4da-4f12-ba52-40a6527f8d60/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 14:43:13.413020 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-2d7fd4df-ba58-45e3-8734-5424b9bc2996 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:43:13.414141 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-2d7fd4df-ba58-45e3-8734-5424b9bc2996 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:43:13.421873 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-2d7fd4df-ba58-45e3-8734-5424b9bc2996 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:13.422371 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-2d7fd4df-ba58-45e3-8734-5424b9bc2996 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:13.423822 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-2d7fd4df-ba58-45e3-8734-5424b9bc2996 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:13.423822 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-2d7fd4df-ba58-45e3-8734-5424b9bc2996 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:13.653473 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-60c7a432-024a-4eee-b0f5-286dbd22c593 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-846502510", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1252179120", "security_groups": [{"name": "tempest-secgroup-smoke-1421120797"}], "block_device_mapping_v2": [{"uuid": "d01b267c-9b0d-4a60-9afc-26bd7910eecc", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b46e8eee-36c4-4173-8e97-a52c3b403e49"}]}} {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:43:13.733872 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-2d7fd4df-ba58-45e3-8734-5424b9bc2996 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb4b0cf5f8b4274b787f327793964f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ba26b86c7243dab8e6c6b84ed674e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:13.742952 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-2d7fd4df-ba58-45e3-8734-5424b9bc2996 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6" status: 200 len: 1725 microversion: 2.1 time: 0.334511 Jun 07 14:43:13.749015 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 185/384] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:43:13 2022] GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 => generated 1725 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:43:13.770436 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.network.neutron [None req-60c7a432-024a-4eee-b0f5-286dbd22c593 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] validate_networks() for [('b46e8eee-36c4-4173-8e97-a52c3b403e49', None, None, None, None, None)] {{(pid=118158) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 14:43:14.027007 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [req-734356d9-aaf3-4bdd-b576-9a87bfa0f5fa req-4cf3b65c-1e9c-4b6f-8fae-e06e36235c2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a06b2dd5-e4da-4f12-ba52-40a6527f8d60", "tag": "9131e5ca-5201-41c7-94aa-a5c0e37a07f7"}]} {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:43:14.035466 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [req-734356d9-aaf3-4bdd-b576-9a87bfa0f5fa req-4cf3b65c-1e9c-4b6f-8fae-e06e36235c2e service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:14.036174 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [req-734356d9-aaf3-4bdd-b576-9a87bfa0f5fa req-4cf3b65c-1e9c-4b6f-8fae-e06e36235c2e service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:14.053303 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.compute.server_external_events [req-734356d9-aaf3-4bdd-b576-9a87bfa0f5fa req-4cf3b65c-1e9c-4b6f-8fae-e06e36235c2e service nova] Creating event network-changed:9131e5ca-5201-41c7-94aa-a5c0e37a07f7 for instance a06b2dd5-e4da-4f12-ba52-40a6527f8d60 on hv-cinder-84497 Jun 07 14:43:14.059694 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [req-734356d9-aaf3-4bdd-b576-9a87bfa0f5fa req-4cf3b65c-1e9c-4b6f-8fae-e06e36235c2e service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036848 Jun 07 14:43:14.060478 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 186/385] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jun 7 14:43:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 14:43:14.255031 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.virt.hardware [None req-60c7a432-024a-4eee-b0f5-286dbd22c593 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Flavor limits 0:0:0 {{(pid=118158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 14:43:14.255593 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.virt.hardware [None req-60c7a432-024a-4eee-b0f5-286dbd22c593 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Image limits 0:0:0 {{(pid=118158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 14:43:14.256601 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.virt.hardware [None req-60c7a432-024a-4eee-b0f5-286dbd22c593 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Flavor pref 0:0:0 {{(pid=118158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 14:43:14.257236 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.virt.hardware [None req-60c7a432-024a-4eee-b0f5-286dbd22c593 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Image pref 0:0:0 {{(pid=118158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 14:43:14.258038 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.virt.hardware [None req-60c7a432-024a-4eee-b0f5-286dbd22c593 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 14:43:14.270354 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-60c7a432-024a-4eee-b0f5-286dbd22c593 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:14.270972 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-60c7a432-024a-4eee-b0f5-286dbd22c593 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:14.274547 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-60c7a432-024a-4eee-b0f5-286dbd22c593 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:14.274547 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-60c7a432-024a-4eee-b0f5-286dbd22c593 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:14.292022 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.quota [None req-60c7a432-024a-4eee-b0f5-286dbd22c593 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Getting quotas for project 93e877695d0f46339cb4b9b86aac3662. Resources: {'instances', 'cores', 'ram'} {{(pid=118158) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 14:43:14.296636 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.quota [None req-60c7a432-024a-4eee-b0f5-286dbd22c593 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Getting quotas for user 0a15f5fa82414bdf8ca3f6723c0a8d2d and project 93e877695d0f46339cb4b9b86aac3662. Resources: {'instances', 'cores', 'ram'} {{(pid=118158) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 14:43:14.359316 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-60c7a432-024a-4eee-b0f5-286dbd22c593 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Going to run 1 instances... {{(pid=118158) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 14:43:14.360625 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-60c7a432-024a-4eee-b0f5-286dbd22c593 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: bac69e34-ec55-4f0b-8856-8411fe7ea17a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d01b267c-9b0d-4a60-9afc-26bd7910eecc',volume_size=None,volume_type=None)] {{(pid=118158) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 14:43:14.765005 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-9f886c8d-27db-430b-92e3-f41c2ebf25b3 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:43:14.765904 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-9f886c8d-27db-430b-92e3-f41c2ebf25b3 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:43:14.773301 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-9f886c8d-27db-430b-92e3-f41c2ebf25b3 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:14.776132 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-9f886c8d-27db-430b-92e3-f41c2ebf25b3 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:14.776132 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-9f886c8d-27db-430b-92e3-f41c2ebf25b3 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:14.776132 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-9f886c8d-27db-430b-92e3-f41c2ebf25b3 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:14.794049 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG dbcounter [-] [118157] Writing DB stats nova_cell1:SELECT=100 {{(pid=118157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:43:14.824895 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-60c7a432-024a-4eee-b0f5-286dbd22c593 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.172807 Jun 07 14:43:14.827311 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 200/386] 10.222.0.85 () {60 vars in 1146 bytes} [Tue Jun 7 14:43:13 2022] POST /compute/v2.1/servers => generated 406 bytes in 1178 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 07 14:43:14.839755 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-46bf13f4-8ed8-4dea-a474-ca6c878f4192 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:43:14.840658 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-46bf13f4-8ed8-4dea-a474-ca6c878f4192 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: bac69e34-ec55-4f0b-8856-8411fe7ea17a] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:43:14.924163 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-46bf13f4-8ed8-4dea-a474-ca6c878f4192 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15f5fa82414bdf8ca3f6723c0a8d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e877695d0f46339cb4b9b86aac3662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:14.936729 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-46bf13f4-8ed8-4dea-a474-ca6c878f4192 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "GET /compute/v2.1/servers/bac69e34-ec55-4f0b-8856-8411fe7ea17a" status: 200 len: 1094 microversion: 2.1 time: 0.103400 Jun 07 14:43:14.940724 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 201/387] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:43:14 2022] GET /compute/v2.1/servers/bac69e34-ec55-4f0b-8856-8411fe7ea17a => generated 1094 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:43:14.968665 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-9f886c8d-27db-430b-92e3-f41c2ebf25b3 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb4b0cf5f8b4274b787f327793964f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ba26b86c7243dab8e6c6b84ed674e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:14.977601 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-9f886c8d-27db-430b-92e3-f41c2ebf25b3 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6" status: 200 len: 1702 microversion: 2.1 time: 0.217798 Jun 07 14:43:14.977975 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 187/388] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:43:14 2022] GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 => generated 1702 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:43:14.995195 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-91dfe019-5d45-4c2a-bda4-70983e638bcf tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:43:15.001587 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-91dfe019-5d45-4c2a-bda4-70983e638bcf tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:15.002054 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-91dfe019-5d45-4c2a-bda4-70983e638bcf tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:15.005889 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG dbcounter [-] [118158] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:43:15.025913 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-91dfe019-5d45-4c2a-bda4-70983e638bcf tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6] Going to try to start instance {{(pid=118158) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 07 14:43:15.194788 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-91dfe019-5d45-4c2a-bda4-70983e638bcf tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "POST /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6/action" status: 202 len: 0 microversion: 2.1 time: 0.203198 Jun 07 14:43:15.198110 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 202/389] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Jun 7 14:43:14 2022] POST /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6/action => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 14:43:15.204411 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-26f7addf-bdc1-4c4d-af8b-0bd5e69bf4d0 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:43:15.205267 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-26f7addf-bdc1-4c4d-af8b-0bd5e69bf4d0 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:43:15.213529 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-26f7addf-bdc1-4c4d-af8b-0bd5e69bf4d0 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:15.213529 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-26f7addf-bdc1-4c4d-af8b-0bd5e69bf4d0 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:15.213858 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-26f7addf-bdc1-4c4d-af8b-0bd5e69bf4d0 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:15.214305 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-26f7addf-bdc1-4c4d-af8b-0bd5e69bf4d0 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:15.369566 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-26f7addf-bdc1-4c4d-af8b-0bd5e69bf4d0 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb4b0cf5f8b4274b787f327793964f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ba26b86c7243dab8e6c6b84ed674e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:15.377959 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-26f7addf-bdc1-4c4d-af8b-0bd5e69bf4d0 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6" status: 200 len: 1711 microversion: 2.1 time: 0.177805 Jun 07 14:43:15.378529 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 188/390] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:43:15 2022] GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 => generated 1711 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:43:15.954619 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-f35264a4-f79d-422b-99c8-45e0640236ef tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:43:15.955325 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-f35264a4-f79d-422b-99c8-45e0640236ef tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: bac69e34-ec55-4f0b-8856-8411fe7ea17a] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:43:15.962975 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-f35264a4-f79d-422b-99c8-45e0640236ef tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:15.963427 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-f35264a4-f79d-422b-99c8-45e0640236ef tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:15.964214 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-f35264a4-f79d-422b-99c8-45e0640236ef tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:15.964699 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-f35264a4-f79d-422b-99c8-45e0640236ef tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:16.040925 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-f35264a4-f79d-422b-99c8-45e0640236ef tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15f5fa82414bdf8ca3f6723c0a8d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e877695d0f46339cb4b9b86aac3662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:16.055592 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-f35264a4-f79d-422b-99c8-45e0640236ef tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "GET /compute/v2.1/servers/bac69e34-ec55-4f0b-8856-8411fe7ea17a" status: 200 len: 1144 microversion: 2.1 time: 0.105367 Jun 07 14:43:16.057867 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 203/391] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:43:15 2022] GET /compute/v2.1/servers/bac69e34-ec55-4f0b-8856-8411fe7ea17a => generated 1144 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:43:16.396743 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-f039f80e-b65f-4be5-816c-6798893d9c12 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:43:16.399230 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-f039f80e-b65f-4be5-816c-6798893d9c12 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:43:16.406643 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-f039f80e-b65f-4be5-816c-6798893d9c12 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:16.407088 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-f039f80e-b65f-4be5-816c-6798893d9c12 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:16.407862 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-f039f80e-b65f-4be5-816c-6798893d9c12 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:16.408295 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-f039f80e-b65f-4be5-816c-6798893d9c12 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:16.541805 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-f039f80e-b65f-4be5-816c-6798893d9c12 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb4b0cf5f8b4274b787f327793964f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ba26b86c7243dab8e6c6b84ed674e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:16.549912 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-f039f80e-b65f-4be5-816c-6798893d9c12 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6" status: 200 len: 1711 microversion: 2.1 time: 0.158381 Jun 07 14:43:16.550411 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 189/392] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:43:16 2022] GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 => generated 1711 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:43:16.737206 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-6070d343-d10b-4c8a-8afa-c60cb7dd0e1d tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5b6c7eef-67fe-49e1-a0ee-9d707d98e15c", "device": "/dev/sdb"}} {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:43:16.738833 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-6070d343-d10b-4c8a-8afa-c60cb7dd0e1d tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] [instance: ac2c33a4-21c2-47b7-9a97-7e3d49c3653a] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:43:16.745457 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-6070d343-d10b-4c8a-8afa-c60cb7dd0e1d tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:16.745906 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-6070d343-d10b-4c8a-8afa-c60cb7dd0e1d tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:16.750749 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-6070d343-d10b-4c8a-8afa-c60cb7dd0e1d tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:16.750749 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-6070d343-d10b-4c8a-8afa-c60cb7dd0e1d tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:17.075333 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-72ca1857-d95d-4f07-ab69-d7904a963c43 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:43:17.075969 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-72ca1857-d95d-4f07-ab69-d7904a963c43 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: bac69e34-ec55-4f0b-8856-8411fe7ea17a] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:43:17.082427 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-72ca1857-d95d-4f07-ab69-d7904a963c43 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:17.083098 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-72ca1857-d95d-4f07-ab69-d7904a963c43 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:17.083630 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-72ca1857-d95d-4f07-ab69-d7904a963c43 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:17.084064 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-72ca1857-d95d-4f07-ab69-d7904a963c43 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:17.164529 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-72ca1857-d95d-4f07-ab69-d7904a963c43 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15f5fa82414bdf8ca3f6723c0a8d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e877695d0f46339cb4b9b86aac3662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:17.174713 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-72ca1857-d95d-4f07-ab69-d7904a963c43 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "GET /compute/v2.1/servers/bac69e34-ec55-4f0b-8856-8411fe7ea17a" status: 200 len: 1192 microversion: 2.1 time: 0.104174 Jun 07 14:43:17.175360 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 190/393] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:43:17 2022] GET /compute/v2.1/servers/bac69e34-ec55-4f0b-8856-8411fe7ea17a => generated 1192 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:43:17.567211 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-a8a19476-d201-4a38-ba6c-1bb76e4a9ea5 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:43:17.567859 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-a8a19476-d201-4a38-ba6c-1bb76e4a9ea5 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:43:17.575071 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-a8a19476-d201-4a38-ba6c-1bb76e4a9ea5 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:17.575514 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-a8a19476-d201-4a38-ba6c-1bb76e4a9ea5 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:17.576300 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-a8a19476-d201-4a38-ba6c-1bb76e4a9ea5 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:17.576767 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-a8a19476-d201-4a38-ba6c-1bb76e4a9ea5 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:17.718399 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-a8a19476-d201-4a38-ba6c-1bb76e4a9ea5 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb4b0cf5f8b4274b787f327793964f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ba26b86c7243dab8e6c6b84ed674e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:17.727051 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-a8a19476-d201-4a38-ba6c-1bb76e4a9ea5 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6" status: 200 len: 1715 microversion: 2.1 time: 0.163635 Jun 07 14:43:17.727623 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 191/394] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:43:17 2022] GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 => generated 1715 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:43:18.197964 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-6aa833fc-39f0-47d5-932d-ddc403ab8cca tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:43:18.198664 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-6aa833fc-39f0-47d5-932d-ddc403ab8cca tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: bac69e34-ec55-4f0b-8856-8411fe7ea17a] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:43:18.204957 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-6aa833fc-39f0-47d5-932d-ddc403ab8cca tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:18.205472 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-6aa833fc-39f0-47d5-932d-ddc403ab8cca tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:18.206850 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-6aa833fc-39f0-47d5-932d-ddc403ab8cca tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:18.206850 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-6aa833fc-39f0-47d5-932d-ddc403ab8cca tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:18.209766 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-6070d343-d10b-4c8a-8afa-c60cb7dd0e1d tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] 10.222.0.85 "POST /compute/v2.1/servers/ac2c33a4-21c2-47b7-9a97-7e3d49c3653a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.474979 Jun 07 14:43:18.210475 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 204/395] 10.222.0.85 () {60 vars in 1322 bytes} [Tue Jun 7 14:43:16 2022] POST /compute/v2.1/servers/ac2c33a4-21c2-47b7-9a97-7e3d49c3653a/os-volume_attachments => generated 194 bytes in 1478 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 14:43:18.278973 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-6aa833fc-39f0-47d5-932d-ddc403ab8cca tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15f5fa82414bdf8ca3f6723c0a8d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e877695d0f46339cb4b9b86aac3662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:18.286729 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-6aa833fc-39f0-47d5-932d-ddc403ab8cca tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "GET /compute/v2.1/servers/bac69e34-ec55-4f0b-8856-8411fe7ea17a" status: 200 len: 1210 microversion: 2.1 time: 0.093217 Jun 07 14:43:18.287548 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 192/396] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:43:18 2022] GET /compute/v2.1/servers/bac69e34-ec55-4f0b-8856-8411fe7ea17a => generated 1210 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:43:19.306118 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-16ab4f4a-c150-4b39-a7ef-9b4fc561edc7 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:43:19.307408 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-16ab4f4a-c150-4b39-a7ef-9b4fc561edc7 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: bac69e34-ec55-4f0b-8856-8411fe7ea17a] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:43:19.315618 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-16ab4f4a-c150-4b39-a7ef-9b4fc561edc7 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:19.316308 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-16ab4f4a-c150-4b39-a7ef-9b4fc561edc7 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:19.317282 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-16ab4f4a-c150-4b39-a7ef-9b4fc561edc7 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:19.317871 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-16ab4f4a-c150-4b39-a7ef-9b4fc561edc7 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:19.504494 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-16ab4f4a-c150-4b39-a7ef-9b4fc561edc7 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15f5fa82414bdf8ca3f6723c0a8d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e877695d0f46339cb4b9b86aac3662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:19.505655 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-16ab4f4a-c150-4b39-a7ef-9b4fc561edc7 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "GET /compute/v2.1/servers/bac69e34-ec55-4f0b-8856-8411fe7ea17a" status: 200 len: 1278 microversion: 2.1 time: 0.204413 Jun 07 14:43:19.506239 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 205/397] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:43:19 2022] GET /compute/v2.1/servers/bac69e34-ec55-4f0b-8856-8411fe7ea17a => generated 1278 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:43:19.550140 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [req-699cceca-98f3-4012-8f85-3f27090bea30 req-0be7b12e-e383-4232-9acd-6910f6dc26cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bac69e34-ec55-4f0b-8856-8411fe7ea17a", "tag": "9c17af0a-e236-4760-ab4a-8f9ffaff1a14"}]} {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:43:19.560098 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [req-699cceca-98f3-4012-8f85-3f27090bea30 req-0be7b12e-e383-4232-9acd-6910f6dc26cd service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:19.560830 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [req-699cceca-98f3-4012-8f85-3f27090bea30 req-0be7b12e-e383-4232-9acd-6910f6dc26cd service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:19.575033 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.compute.server_external_events [req-699cceca-98f3-4012-8f85-3f27090bea30 req-0be7b12e-e383-4232-9acd-6910f6dc26cd service nova] Creating event network-changed:9c17af0a-e236-4760-ab4a-8f9ffaff1a14 for instance bac69e34-ec55-4f0b-8856-8411fe7ea17a on hv-cinder-84497 Jun 07 14:43:19.580615 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [req-699cceca-98f3-4012-8f85-3f27090bea30 req-0be7b12e-e383-4232-9acd-6910f6dc26cd service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034701 Jun 07 14:43:19.581563 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 193/398] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jun 7 14:43:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:43:20.521930 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-d2d1c007-3cd4-4c46-9718-5306ffc4ab41 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:43:20.522555 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-d2d1c007-3cd4-4c46-9718-5306ffc4ab41 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: bac69e34-ec55-4f0b-8856-8411fe7ea17a] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:43:20.529724 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-d2d1c007-3cd4-4c46-9718-5306ffc4ab41 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:20.530176 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-d2d1c007-3cd4-4c46-9718-5306ffc4ab41 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:20.530942 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-d2d1c007-3cd4-4c46-9718-5306ffc4ab41 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:20.531386 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-d2d1c007-3cd4-4c46-9718-5306ffc4ab41 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:20.661504 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-d2d1c007-3cd4-4c46-9718-5306ffc4ab41 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15f5fa82414bdf8ca3f6723c0a8d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e877695d0f46339cb4b9b86aac3662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:20.668897 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-d2d1c007-3cd4-4c46-9718-5306ffc4ab41 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "GET /compute/v2.1/servers/bac69e34-ec55-4f0b-8856-8411fe7ea17a" status: 200 len: 1266 microversion: 2.1 time: 0.151002 Jun 07 14:43:20.669448 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 206/399] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:43:20 2022] GET /compute/v2.1/servers/bac69e34-ec55-4f0b-8856-8411fe7ea17a => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:43:21.686848 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-9a9785b5-0db8-4957-8361-29c487e39e69 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:43:21.687463 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-9a9785b5-0db8-4957-8361-29c487e39e69 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: bac69e34-ec55-4f0b-8856-8411fe7ea17a] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:43:21.693650 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-9a9785b5-0db8-4957-8361-29c487e39e69 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:21.694092 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-9a9785b5-0db8-4957-8361-29c487e39e69 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:21.694846 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-9a9785b5-0db8-4957-8361-29c487e39e69 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:21.695276 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-9a9785b5-0db8-4957-8361-29c487e39e69 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:21.834779 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-9a9785b5-0db8-4957-8361-29c487e39e69 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15f5fa82414bdf8ca3f6723c0a8d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e877695d0f46339cb4b9b86aac3662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:21.842416 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-9a9785b5-0db8-4957-8361-29c487e39e69 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "GET /compute/v2.1/servers/bac69e34-ec55-4f0b-8856-8411fe7ea17a" status: 200 len: 1266 microversion: 2.1 time: 0.160724 Jun 07 14:43:21.843062 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 194/400] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:43:21 2022] GET /compute/v2.1/servers/bac69e34-ec55-4f0b-8856-8411fe7ea17a => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:43:22.859114 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-12be6c84-117d-4f12-b281-e4b85e2e200a tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:43:22.859743 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-12be6c84-117d-4f12-b281-e4b85e2e200a tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: bac69e34-ec55-4f0b-8856-8411fe7ea17a] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:43:22.866233 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-12be6c84-117d-4f12-b281-e4b85e2e200a tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:22.866683 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-12be6c84-117d-4f12-b281-e4b85e2e200a tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:22.867441 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-12be6c84-117d-4f12-b281-e4b85e2e200a tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:22.867889 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-12be6c84-117d-4f12-b281-e4b85e2e200a tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:23.002236 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-12be6c84-117d-4f12-b281-e4b85e2e200a tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15f5fa82414bdf8ca3f6723c0a8d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e877695d0f46339cb4b9b86aac3662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:23.009623 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-12be6c84-117d-4f12-b281-e4b85e2e200a tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "GET /compute/v2.1/servers/bac69e34-ec55-4f0b-8856-8411fe7ea17a" status: 200 len: 1266 microversion: 2.1 time: 0.154433 Jun 07 14:43:23.010675 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 207/401] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:43:22 2022] GET /compute/v2.1/servers/bac69e34-ec55-4f0b-8856-8411fe7ea17a => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:43:24.027011 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-35af9bc6-f3f4-4b8c-9c3c-6f456ab18e93 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:43:24.027554 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-35af9bc6-f3f4-4b8c-9c3c-6f456ab18e93 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: bac69e34-ec55-4f0b-8856-8411fe7ea17a] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:43:24.034100 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-35af9bc6-f3f4-4b8c-9c3c-6f456ab18e93 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:24.034549 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-35af9bc6-f3f4-4b8c-9c3c-6f456ab18e93 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:24.035309 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-35af9bc6-f3f4-4b8c-9c3c-6f456ab18e93 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:24.035743 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-35af9bc6-f3f4-4b8c-9c3c-6f456ab18e93 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:24.172065 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-35af9bc6-f3f4-4b8c-9c3c-6f456ab18e93 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15f5fa82414bdf8ca3f6723c0a8d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e877695d0f46339cb4b9b86aac3662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:24.179552 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-35af9bc6-f3f4-4b8c-9c3c-6f456ab18e93 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "GET /compute/v2.1/servers/bac69e34-ec55-4f0b-8856-8411fe7ea17a" status: 200 len: 1266 microversion: 2.1 time: 0.156499 Jun 07 14:43:24.180108 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 195/402] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:43:24 2022] GET /compute/v2.1/servers/bac69e34-ec55-4f0b-8856-8411fe7ea17a => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:43:25.197023 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-47f213ed-996d-4430-8c8a-1c3e82735f54 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:43:25.197641 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-47f213ed-996d-4430-8c8a-1c3e82735f54 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: bac69e34-ec55-4f0b-8856-8411fe7ea17a] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:43:25.199989 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG dbcounter [-] [118158] Writing DB stats nova_cell0:SELECT=2 {{(pid=118158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:43:25.200705 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG dbcounter [-] [118158] Writing DB stats nova_cell0:SELECT=8 {{(pid=118158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:43:25.205540 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-47f213ed-996d-4430-8c8a-1c3e82735f54 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:25.205988 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-47f213ed-996d-4430-8c8a-1c3e82735f54 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:25.206752 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-47f213ed-996d-4430-8c8a-1c3e82735f54 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:25.207188 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-47f213ed-996d-4430-8c8a-1c3e82735f54 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:25.342343 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-47f213ed-996d-4430-8c8a-1c3e82735f54 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15f5fa82414bdf8ca3f6723c0a8d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e877695d0f46339cb4b9b86aac3662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:25.351438 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-47f213ed-996d-4430-8c8a-1c3e82735f54 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "GET /compute/v2.1/servers/bac69e34-ec55-4f0b-8856-8411fe7ea17a" status: 200 len: 1266 microversion: 2.1 time: 0.158190 Jun 07 14:43:25.352009 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 208/403] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:43:25 2022] GET /compute/v2.1/servers/bac69e34-ec55-4f0b-8856-8411fe7ea17a => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:43:26.368915 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-a315117f-b851-419b-be7e-374dbdae8079 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:43:26.369598 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-a315117f-b851-419b-be7e-374dbdae8079 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: bac69e34-ec55-4f0b-8856-8411fe7ea17a] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:43:26.372929 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG dbcounter [-] [118157] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3 {{(pid=118157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:43:26.380294 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-a315117f-b851-419b-be7e-374dbdae8079 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:26.386030 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-a315117f-b851-419b-be7e-374dbdae8079 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:26.386030 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-a315117f-b851-419b-be7e-374dbdae8079 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:26.386030 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-a315117f-b851-419b-be7e-374dbdae8079 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:26.524171 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-a315117f-b851-419b-be7e-374dbdae8079 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15f5fa82414bdf8ca3f6723c0a8d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e877695d0f46339cb4b9b86aac3662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:26.532017 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-a315117f-b851-419b-be7e-374dbdae8079 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "GET /compute/v2.1/servers/bac69e34-ec55-4f0b-8856-8411fe7ea17a" status: 200 len: 1266 microversion: 2.1 time: 0.166944 Jun 07 14:43:26.532607 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 196/404] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:43:26 2022] GET /compute/v2.1/servers/bac69e34-ec55-4f0b-8856-8411fe7ea17a => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:43:27.550181 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-f097fb83-63c0-4f9c-8ee7-030a01f9eb0a tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:43:27.550790 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-f097fb83-63c0-4f9c-8ee7-030a01f9eb0a tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: bac69e34-ec55-4f0b-8856-8411fe7ea17a] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:43:27.557350 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-f097fb83-63c0-4f9c-8ee7-030a01f9eb0a tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:27.557825 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-f097fb83-63c0-4f9c-8ee7-030a01f9eb0a tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:27.558586 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-f097fb83-63c0-4f9c-8ee7-030a01f9eb0a tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:27.559018 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-f097fb83-63c0-4f9c-8ee7-030a01f9eb0a tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:27.692036 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-f097fb83-63c0-4f9c-8ee7-030a01f9eb0a tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15f5fa82414bdf8ca3f6723c0a8d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e877695d0f46339cb4b9b86aac3662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:27.702305 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-f097fb83-63c0-4f9c-8ee7-030a01f9eb0a tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "GET /compute/v2.1/servers/bac69e34-ec55-4f0b-8856-8411fe7ea17a" status: 200 len: 1266 microversion: 2.1 time: 0.156425 Jun 07 14:43:27.708224 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 209/405] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:43:27 2022] GET /compute/v2.1/servers/bac69e34-ec55-4f0b-8856-8411fe7ea17a => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:43:28.722997 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-09c8e112-d07a-4b7c-8bc8-fb6609aec4d7 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:43:28.723678 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-09c8e112-d07a-4b7c-8bc8-fb6609aec4d7 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: bac69e34-ec55-4f0b-8856-8411fe7ea17a] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:43:28.730805 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-09c8e112-d07a-4b7c-8bc8-fb6609aec4d7 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:28.731245 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-09c8e112-d07a-4b7c-8bc8-fb6609aec4d7 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:28.732032 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-09c8e112-d07a-4b7c-8bc8-fb6609aec4d7 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:28.732509 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-09c8e112-d07a-4b7c-8bc8-fb6609aec4d7 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:28.878179 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-09c8e112-d07a-4b7c-8bc8-fb6609aec4d7 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15f5fa82414bdf8ca3f6723c0a8d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e877695d0f46339cb4b9b86aac3662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:28.886172 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-09c8e112-d07a-4b7c-8bc8-fb6609aec4d7 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "GET /compute/v2.1/servers/bac69e34-ec55-4f0b-8856-8411fe7ea17a" status: 200 len: 1266 microversion: 2.1 time: 0.167289 Jun 07 14:43:28.886732 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 197/406] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:43:28 2022] GET /compute/v2.1/servers/bac69e34-ec55-4f0b-8856-8411fe7ea17a => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:43:29.902681 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-f67bde25-9d4b-4176-8e0b-b8664ca76ced tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:43:29.903295 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-f67bde25-9d4b-4176-8e0b-b8664ca76ced tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: bac69e34-ec55-4f0b-8856-8411fe7ea17a] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:43:29.905737 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG dbcounter [-] [118158] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=118158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:43:29.910586 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-f67bde25-9d4b-4176-8e0b-b8664ca76ced tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:29.911043 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-f67bde25-9d4b-4176-8e0b-b8664ca76ced tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:29.911826 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-f67bde25-9d4b-4176-8e0b-b8664ca76ced tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:29.912265 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-f67bde25-9d4b-4176-8e0b-b8664ca76ced tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:30.042692 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-f67bde25-9d4b-4176-8e0b-b8664ca76ced tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15f5fa82414bdf8ca3f6723c0a8d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e877695d0f46339cb4b9b86aac3662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:30.050172 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-f67bde25-9d4b-4176-8e0b-b8664ca76ced tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "GET /compute/v2.1/servers/bac69e34-ec55-4f0b-8856-8411fe7ea17a" status: 200 len: 1266 microversion: 2.1 time: 0.151962 Jun 07 14:43:30.050784 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 210/407] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:43:29 2022] GET /compute/v2.1/servers/bac69e34-ec55-4f0b-8856-8411fe7ea17a => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:43:30.074260 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-fff5ff3a-d95f-4894-a355-d4029d5cb043 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:43:30.074833 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-fff5ff3a-d95f-4894-a355-d4029d5cb043 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:43:30.081382 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-fff5ff3a-d95f-4894-a355-d4029d5cb043 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:30.081840 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-fff5ff3a-d95f-4894-a355-d4029d5cb043 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:30.082617 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-fff5ff3a-d95f-4894-a355-d4029d5cb043 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:30.083045 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-fff5ff3a-d95f-4894-a355-d4029d5cb043 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:30.105972 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-fff5ff3a-d95f-4894-a355-d4029d5cb043 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089/ips" status: 200 len: 151 microversion: 2.20 time: 0.036249 Jun 07 14:43:30.106553 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 198/408] 10.222.0.85 () {60 vars in 1288 bytes} [Tue Jun 7 14:43:30 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089/ips => generated 151 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 14:43:31.067398 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-ff00fb4d-de4c-4176-97fb-aa10f65f69a3 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:43:31.068696 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-ff00fb4d-de4c-4176-97fb-aa10f65f69a3 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: bac69e34-ec55-4f0b-8856-8411fe7ea17a] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:43:31.075585 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-ff00fb4d-de4c-4176-97fb-aa10f65f69a3 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:31.076041 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-ff00fb4d-de4c-4176-97fb-aa10f65f69a3 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:31.076867 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-ff00fb4d-de4c-4176-97fb-aa10f65f69a3 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:31.077307 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-ff00fb4d-de4c-4176-97fb-aa10f65f69a3 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:31.210222 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-ff00fb4d-de4c-4176-97fb-aa10f65f69a3 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15f5fa82414bdf8ca3f6723c0a8d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e877695d0f46339cb4b9b86aac3662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:31.217729 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-ff00fb4d-de4c-4176-97fb-aa10f65f69a3 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "GET /compute/v2.1/servers/bac69e34-ec55-4f0b-8856-8411fe7ea17a" status: 200 len: 1266 microversion: 2.1 time: 0.154241 Jun 07 14:43:31.218277 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 211/409] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:43:31 2022] GET /compute/v2.1/servers/bac69e34-ec55-4f0b-8856-8411fe7ea17a => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:43:32.234758 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-28281234-9013-4427-a022-016f07ca3dd9 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:43:32.235404 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-28281234-9013-4427-a022-016f07ca3dd9 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: bac69e34-ec55-4f0b-8856-8411fe7ea17a] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:43:32.241973 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-28281234-9013-4427-a022-016f07ca3dd9 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:32.242423 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-28281234-9013-4427-a022-016f07ca3dd9 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:32.243191 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-28281234-9013-4427-a022-016f07ca3dd9 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:32.243622 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-28281234-9013-4427-a022-016f07ca3dd9 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:32.372582 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-28281234-9013-4427-a022-016f07ca3dd9 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15f5fa82414bdf8ca3f6723c0a8d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e877695d0f46339cb4b9b86aac3662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:32.380538 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-28281234-9013-4427-a022-016f07ca3dd9 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "GET /compute/v2.1/servers/bac69e34-ec55-4f0b-8856-8411fe7ea17a" status: 200 len: 1266 microversion: 2.1 time: 0.149614 Jun 07 14:43:32.381093 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 199/410] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:43:32 2022] GET /compute/v2.1/servers/bac69e34-ec55-4f0b-8856-8411fe7ea17a => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:43:33.397520 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-9200edcb-d58c-46d4-96a6-a8b4462475b0 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:43:33.398135 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-9200edcb-d58c-46d4-96a6-a8b4462475b0 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: bac69e34-ec55-4f0b-8856-8411fe7ea17a] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:43:33.404492 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-9200edcb-d58c-46d4-96a6-a8b4462475b0 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:33.404938 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-9200edcb-d58c-46d4-96a6-a8b4462475b0 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:33.405696 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-9200edcb-d58c-46d4-96a6-a8b4462475b0 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:33.406126 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-9200edcb-d58c-46d4-96a6-a8b4462475b0 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:33.536085 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-9200edcb-d58c-46d4-96a6-a8b4462475b0 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15f5fa82414bdf8ca3f6723c0a8d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e877695d0f46339cb4b9b86aac3662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:33.544206 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-9200edcb-d58c-46d4-96a6-a8b4462475b0 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "GET /compute/v2.1/servers/bac69e34-ec55-4f0b-8856-8411fe7ea17a" status: 200 len: 1266 microversion: 2.1 time: 0.150578 Jun 07 14:43:33.544806 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 212/411] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:43:33 2022] GET /compute/v2.1/servers/bac69e34-ec55-4f0b-8856-8411fe7ea17a => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:43:34.560681 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-6a422ea4-19ef-4e66-8a49-bd72404ccf4f tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:43:34.561300 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-6a422ea4-19ef-4e66-8a49-bd72404ccf4f tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: bac69e34-ec55-4f0b-8856-8411fe7ea17a] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:43:34.571080 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-6a422ea4-19ef-4e66-8a49-bd72404ccf4f tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:34.571900 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-6a422ea4-19ef-4e66-8a49-bd72404ccf4f tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:34.573353 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-6a422ea4-19ef-4e66-8a49-bd72404ccf4f tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:34.574125 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-6a422ea4-19ef-4e66-8a49-bd72404ccf4f tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:34.713153 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-6a422ea4-19ef-4e66-8a49-bd72404ccf4f tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15f5fa82414bdf8ca3f6723c0a8d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e877695d0f46339cb4b9b86aac3662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:34.721714 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-6a422ea4-19ef-4e66-8a49-bd72404ccf4f tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "GET /compute/v2.1/servers/bac69e34-ec55-4f0b-8856-8411fe7ea17a" status: 200 len: 1266 microversion: 2.1 time: 0.164943 Jun 07 14:43:34.722268 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 200/412] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:43:34 2022] GET /compute/v2.1/servers/bac69e34-ec55-4f0b-8856-8411fe7ea17a => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:43:35.648240 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [req-2c5e80ec-816f-4a21-9099-f3ee9ca6f2bf req-9633fbcf-9351-43f3-b483-4ad91b7f2a4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bac69e34-ec55-4f0b-8856-8411fe7ea17a", "name": "network-vif-plugged", "status": "completed", "tag": "9c17af0a-e236-4760-ab4a-8f9ffaff1a14"}]} {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:43:35.657556 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [req-2c5e80ec-816f-4a21-9099-f3ee9ca6f2bf req-9633fbcf-9351-43f3-b483-4ad91b7f2a4d service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:35.658051 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [req-2c5e80ec-816f-4a21-9099-f3ee9ca6f2bf req-9633fbcf-9351-43f3-b483-4ad91b7f2a4d service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:35.669522 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.compute.server_external_events [req-2c5e80ec-816f-4a21-9099-f3ee9ca6f2bf req-9633fbcf-9351-43f3-b483-4ad91b7f2a4d service nova] Creating event network-vif-plugged:9c17af0a-e236-4760-ab4a-8f9ffaff1a14 for instance bac69e34-ec55-4f0b-8856-8411fe7ea17a on hv-cinder-84497 Jun 07 14:43:35.684059 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [req-2c5e80ec-816f-4a21-9099-f3ee9ca6f2bf req-9633fbcf-9351-43f3-b483-4ad91b7f2a4d service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030436 Jun 07 14:43:35.684059 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 213/413] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jun 7 14:43:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:43:35.739756 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-4e58ab4c-5199-41de-a9e2-5e3178486da8 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:43:35.741647 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-4e58ab4c-5199-41de-a9e2-5e3178486da8 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: bac69e34-ec55-4f0b-8856-8411fe7ea17a] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:43:35.748366 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-4e58ab4c-5199-41de-a9e2-5e3178486da8 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:35.748920 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-4e58ab4c-5199-41de-a9e2-5e3178486da8 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:35.749697 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-4e58ab4c-5199-41de-a9e2-5e3178486da8 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:35.750135 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-4e58ab4c-5199-41de-a9e2-5e3178486da8 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:35.891390 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-4e58ab4c-5199-41de-a9e2-5e3178486da8 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15f5fa82414bdf8ca3f6723c0a8d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e877695d0f46339cb4b9b86aac3662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:35.899110 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-4e58ab4c-5199-41de-a9e2-5e3178486da8 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "GET /compute/v2.1/servers/bac69e34-ec55-4f0b-8856-8411fe7ea17a" status: 200 len: 1266 microversion: 2.1 time: 0.164091 Jun 07 14:43:35.899669 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 201/414] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:43:35 2022] GET /compute/v2.1/servers/bac69e34-ec55-4f0b-8856-8411fe7ea17a => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:43:36.662906 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-506d726c-841f-4803-8470-8576560b85b0 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:43:36.663512 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-506d726c-841f-4803-8470-8576560b85b0 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:43:36.669814 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-506d726c-841f-4803-8470-8576560b85b0 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:36.670262 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-506d726c-841f-4803-8470-8576560b85b0 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:36.671028 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-506d726c-841f-4803-8470-8576560b85b0 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:36.671467 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-506d726c-841f-4803-8470-8576560b85b0 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:36.696351 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.objects.instance [None req-506d726c-841f-4803-8470-8576560b85b0 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lazy-loading 'flavor' on Instance uuid a8a8352c-4f05-4640-a976-edb025819089 {{(pid=118158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 14:43:36.914965 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-12737f79-74a0-43a8-b553-c0183d334b7f tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:43:36.915535 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-12737f79-74a0-43a8-b553-c0183d334b7f tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: bac69e34-ec55-4f0b-8856-8411fe7ea17a] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:43:36.922170 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-12737f79-74a0-43a8-b553-c0183d334b7f tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:36.922608 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-12737f79-74a0-43a8-b553-c0183d334b7f tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:36.923357 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-12737f79-74a0-43a8-b553-c0183d334b7f tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:36.923790 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-12737f79-74a0-43a8-b553-c0183d334b7f tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:37.055835 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-12737f79-74a0-43a8-b553-c0183d334b7f tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15f5fa82414bdf8ca3f6723c0a8d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e877695d0f46339cb4b9b86aac3662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:37.063594 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-12737f79-74a0-43a8-b553-c0183d334b7f tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "GET /compute/v2.1/servers/bac69e34-ec55-4f0b-8856-8411fe7ea17a" status: 200 len: 1266 microversion: 2.1 time: 0.152448 Jun 07 14:43:37.064140 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 202/415] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:43:36 2022] GET /compute/v2.1/servers/bac69e34-ec55-4f0b-8856-8411fe7ea17a => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:43:37.272037 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-506d726c-841f-4803-8470-8576560b85b0 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "POST /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089/action" status: 202 len: 0 microversion: 2.20 time: 0.613769 Jun 07 14:43:37.272678 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 214/416] 10.222.0.85 () {62 vars in 1318 bytes} [Tue Jun 7 14:43:36 2022] POST /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089/action => generated 0 bytes in 615 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 07 14:43:37.281126 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-1dbdfd29-e8bf-4ad3-8f0b-907a7666123d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:43:37.281741 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-1dbdfd29-e8bf-4ad3-8f0b-907a7666123d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:43:37.287879 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-1dbdfd29-e8bf-4ad3-8f0b-907a7666123d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:37.288330 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-1dbdfd29-e8bf-4ad3-8f0b-907a7666123d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:37.289134 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-1dbdfd29-e8bf-4ad3-8f0b-907a7666123d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:37.289552 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-1dbdfd29-e8bf-4ad3-8f0b-907a7666123d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:37.420952 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-1dbdfd29-e8bf-4ad3-8f0b-907a7666123d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:37.428712 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-1dbdfd29-e8bf-4ad3-8f0b-907a7666123d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:37.430238 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-1dbdfd29-e8bf-4ad3-8f0b-907a7666123d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:37.431385 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-1dbdfd29-e8bf-4ad3-8f0b-907a7666123d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1724 microversion: 2.20 time: 0.154321 Jun 07 14:43:37.432443 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 203/417] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:43:37 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:43:38.081255 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-f64b96ef-a39b-490a-b995-edcb95121da6 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:43:38.081952 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-f64b96ef-a39b-490a-b995-edcb95121da6 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: bac69e34-ec55-4f0b-8856-8411fe7ea17a] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:43:38.088220 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-f64b96ef-a39b-490a-b995-edcb95121da6 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:38.088702 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-f64b96ef-a39b-490a-b995-edcb95121da6 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:38.089469 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-f64b96ef-a39b-490a-b995-edcb95121da6 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:38.089906 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-f64b96ef-a39b-490a-b995-edcb95121da6 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:38.094446 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG dbcounter [-] [118158] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=118158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:43:38.222853 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-f64b96ef-a39b-490a-b995-edcb95121da6 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15f5fa82414bdf8ca3f6723c0a8d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e877695d0f46339cb4b9b86aac3662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:38.230358 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-f64b96ef-a39b-490a-b995-edcb95121da6 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "GET /compute/v2.1/servers/bac69e34-ec55-4f0b-8856-8411fe7ea17a" status: 200 len: 1266 microversion: 2.1 time: 0.153845 Jun 07 14:43:38.231506 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 215/418] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:43:38 2022] GET /compute/v2.1/servers/bac69e34-ec55-4f0b-8856-8411fe7ea17a => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:43:38.451918 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-9c80f131-05a8-4169-8d80-6311ad0d30c8 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:43:38.452714 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-9c80f131-05a8-4169-8d80-6311ad0d30c8 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:43:38.459235 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-9c80f131-05a8-4169-8d80-6311ad0d30c8 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:38.459677 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-9c80f131-05a8-4169-8d80-6311ad0d30c8 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:38.460471 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-9c80f131-05a8-4169-8d80-6311ad0d30c8 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:38.460898 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-9c80f131-05a8-4169-8d80-6311ad0d30c8 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:38.592721 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-9c80f131-05a8-4169-8d80-6311ad0d30c8 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:38.601059 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-9c80f131-05a8-4169-8d80-6311ad0d30c8 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:38.602550 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-9c80f131-05a8-4169-8d80-6311ad0d30c8 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:38.603710 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-9c80f131-05a8-4169-8d80-6311ad0d30c8 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1724 microversion: 2.20 time: 0.157154 Jun 07 14:43:38.604263 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 204/419] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:43:38 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:43:39.247762 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-7f654ad6-1ec5-4f09-a70a-56b9fd6ee55b tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:43:39.248400 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-7f654ad6-1ec5-4f09-a70a-56b9fd6ee55b tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: bac69e34-ec55-4f0b-8856-8411fe7ea17a] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:43:39.254923 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-7f654ad6-1ec5-4f09-a70a-56b9fd6ee55b tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:39.261576 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-7f654ad6-1ec5-4f09-a70a-56b9fd6ee55b tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:39.261576 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-7f654ad6-1ec5-4f09-a70a-56b9fd6ee55b tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:39.261576 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-7f654ad6-1ec5-4f09-a70a-56b9fd6ee55b tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:39.385237 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-7f654ad6-1ec5-4f09-a70a-56b9fd6ee55b tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15f5fa82414bdf8ca3f6723c0a8d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e877695d0f46339cb4b9b86aac3662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:39.392909 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-7f654ad6-1ec5-4f09-a70a-56b9fd6ee55b tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "GET /compute/v2.1/servers/bac69e34-ec55-4f0b-8856-8411fe7ea17a" status: 200 len: 1266 microversion: 2.1 time: 0.149559 Jun 07 14:43:39.393499 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 216/420] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:43:39 2022] GET /compute/v2.1/servers/bac69e34-ec55-4f0b-8856-8411fe7ea17a => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:43:39.621787 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-9c6adc40-b04d-4486-982b-cf890b3056cd tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:43:39.622318 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-9c6adc40-b04d-4486-982b-cf890b3056cd tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:43:39.628590 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-9c6adc40-b04d-4486-982b-cf890b3056cd tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:39.629041 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-9c6adc40-b04d-4486-982b-cf890b3056cd tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:39.629805 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-9c6adc40-b04d-4486-982b-cf890b3056cd tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:39.630242 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-9c6adc40-b04d-4486-982b-cf890b3056cd tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:39.634138 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG dbcounter [-] [118157] Writing DB stats nova_cell1:SELECT=100 {{(pid=118157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:43:39.761941 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-9c6adc40-b04d-4486-982b-cf890b3056cd tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:39.770287 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-9c6adc40-b04d-4486-982b-cf890b3056cd tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:39.771826 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-9c6adc40-b04d-4486-982b-cf890b3056cd tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:39.773076 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-9c6adc40-b04d-4486-982b-cf890b3056cd tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1724 microversion: 2.20 time: 0.155417 Jun 07 14:43:39.773648 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 205/421] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:43:39 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:43:40.411292 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-349f589c-6a86-43f4-a61d-2619e37f124a tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:43:40.411810 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-349f589c-6a86-43f4-a61d-2619e37f124a tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: bac69e34-ec55-4f0b-8856-8411fe7ea17a] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:43:40.418264 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-349f589c-6a86-43f4-a61d-2619e37f124a tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:40.418746 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-349f589c-6a86-43f4-a61d-2619e37f124a tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:40.419513 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-349f589c-6a86-43f4-a61d-2619e37f124a tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:40.419953 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-349f589c-6a86-43f4-a61d-2619e37f124a tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:40.560534 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-349f589c-6a86-43f4-a61d-2619e37f124a tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15f5fa82414bdf8ca3f6723c0a8d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e877695d0f46339cb4b9b86aac3662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:40.568964 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-349f589c-6a86-43f4-a61d-2619e37f124a tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "GET /compute/v2.1/servers/bac69e34-ec55-4f0b-8856-8411fe7ea17a" status: 200 len: 1266 microversion: 2.1 time: 0.161598 Jun 07 14:43:40.569532 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 217/422] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:43:40 2022] GET /compute/v2.1/servers/bac69e34-ec55-4f0b-8856-8411fe7ea17a => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:43:40.793821 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-642cf56d-77ba-4aea-805e-659d0b5e4b51 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:43:40.794538 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-642cf56d-77ba-4aea-805e-659d0b5e4b51 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:43:40.801635 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-642cf56d-77ba-4aea-805e-659d0b5e4b51 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:40.802079 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-642cf56d-77ba-4aea-805e-659d0b5e4b51 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:40.802845 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-642cf56d-77ba-4aea-805e-659d0b5e4b51 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:40.803272 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-642cf56d-77ba-4aea-805e-659d0b5e4b51 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:40.950629 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-642cf56d-77ba-4aea-805e-659d0b5e4b51 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:40.958642 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-642cf56d-77ba-4aea-805e-659d0b5e4b51 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:40.960213 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-642cf56d-77ba-4aea-805e-659d0b5e4b51 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:40.961397 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-642cf56d-77ba-4aea-805e-659d0b5e4b51 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1724 microversion: 2.20 time: 0.172215 Jun 07 14:43:40.961938 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 206/423] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:43:40 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:43:41.585903 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-03f9e27e-a3b7-4781-8e72-0b30f9adeb00 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:43:41.586516 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-03f9e27e-a3b7-4781-8e72-0b30f9adeb00 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: bac69e34-ec55-4f0b-8856-8411fe7ea17a] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:43:41.593949 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-03f9e27e-a3b7-4781-8e72-0b30f9adeb00 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:41.594400 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-03f9e27e-a3b7-4781-8e72-0b30f9adeb00 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:41.595180 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-03f9e27e-a3b7-4781-8e72-0b30f9adeb00 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:41.595626 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-03f9e27e-a3b7-4781-8e72-0b30f9adeb00 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:41.723823 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-03f9e27e-a3b7-4781-8e72-0b30f9adeb00 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15f5fa82414bdf8ca3f6723c0a8d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e877695d0f46339cb4b9b86aac3662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:41.731408 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-03f9e27e-a3b7-4781-8e72-0b30f9adeb00 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "GET /compute/v2.1/servers/bac69e34-ec55-4f0b-8856-8411fe7ea17a" status: 200 len: 1266 microversion: 2.1 time: 0.149306 Jun 07 14:43:41.732203 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 218/424] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:43:41 2022] GET /compute/v2.1/servers/bac69e34-ec55-4f0b-8856-8411fe7ea17a => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:43:41.980015 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-bce6d4a6-5854-45c8-9e46-e864a6b85a02 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:43:41.980672 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-bce6d4a6-5854-45c8-9e46-e864a6b85a02 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:43:41.987286 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-bce6d4a6-5854-45c8-9e46-e864a6b85a02 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:41.987739 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-bce6d4a6-5854-45c8-9e46-e864a6b85a02 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:41.988606 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-bce6d4a6-5854-45c8-9e46-e864a6b85a02 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:41.989045 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-bce6d4a6-5854-45c8-9e46-e864a6b85a02 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:42.120333 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-bce6d4a6-5854-45c8-9e46-e864a6b85a02 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:42.128832 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-bce6d4a6-5854-45c8-9e46-e864a6b85a02 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:42.130330 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-bce6d4a6-5854-45c8-9e46-e864a6b85a02 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:42.131491 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-bce6d4a6-5854-45c8-9e46-e864a6b85a02 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1724 microversion: 2.20 time: 0.155337 Jun 07 14:43:42.132041 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 207/425] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:43:41 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:43:42.747834 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-8f8759ce-1097-45a3-adb0-60e84250276a tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:43:42.748465 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-8f8759ce-1097-45a3-adb0-60e84250276a tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: bac69e34-ec55-4f0b-8856-8411fe7ea17a] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:43:42.754955 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-8f8759ce-1097-45a3-adb0-60e84250276a tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:42.755500 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-8f8759ce-1097-45a3-adb0-60e84250276a tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:42.756273 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-8f8759ce-1097-45a3-adb0-60e84250276a tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:42.756736 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-8f8759ce-1097-45a3-adb0-60e84250276a tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:42.887730 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-8f8759ce-1097-45a3-adb0-60e84250276a tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15f5fa82414bdf8ca3f6723c0a8d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e877695d0f46339cb4b9b86aac3662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:42.895662 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-8f8759ce-1097-45a3-adb0-60e84250276a tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "GET /compute/v2.1/servers/bac69e34-ec55-4f0b-8856-8411fe7ea17a" status: 200 len: 1266 microversion: 2.1 time: 0.152221 Jun 07 14:43:42.896229 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 219/426] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:43:42 2022] GET /compute/v2.1/servers/bac69e34-ec55-4f0b-8856-8411fe7ea17a => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:43:43.150979 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-6d324027-3450-4bb5-873e-34e771bc3cb0 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:43:43.151501 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-6d324027-3450-4bb5-873e-34e771bc3cb0 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:43:43.158007 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-6d324027-3450-4bb5-873e-34e771bc3cb0 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:43.158452 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-6d324027-3450-4bb5-873e-34e771bc3cb0 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:43.159216 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-6d324027-3450-4bb5-873e-34e771bc3cb0 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:43.159755 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-6d324027-3450-4bb5-873e-34e771bc3cb0 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:43.291046 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-6d324027-3450-4bb5-873e-34e771bc3cb0 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:43.299464 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-6d324027-3450-4bb5-873e-34e771bc3cb0 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:43.301019 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-6d324027-3450-4bb5-873e-34e771bc3cb0 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:43.302164 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-6d324027-3450-4bb5-873e-34e771bc3cb0 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1724 microversion: 2.20 time: 0.155162 Jun 07 14:43:43.302718 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 208/427] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:43:43 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:43:43.914453 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-a1a8ea09-6fbd-4fe7-a74e-39484d753d1a tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:43:43.915004 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-a1a8ea09-6fbd-4fe7-a74e-39484d753d1a tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: bac69e34-ec55-4f0b-8856-8411fe7ea17a] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:43:43.921674 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-a1a8ea09-6fbd-4fe7-a74e-39484d753d1a tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:43.922118 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-a1a8ea09-6fbd-4fe7-a74e-39484d753d1a tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:43.922889 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-a1a8ea09-6fbd-4fe7-a74e-39484d753d1a tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:43.923316 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-a1a8ea09-6fbd-4fe7-a74e-39484d753d1a tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:44.064942 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-a1a8ea09-6fbd-4fe7-a74e-39484d753d1a tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15f5fa82414bdf8ca3f6723c0a8d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e877695d0f46339cb4b9b86aac3662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:44.072513 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-a1a8ea09-6fbd-4fe7-a74e-39484d753d1a tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "GET /compute/v2.1/servers/bac69e34-ec55-4f0b-8856-8411fe7ea17a" status: 200 len: 1266 microversion: 2.1 time: 0.162002 Jun 07 14:43:44.073071 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 220/428] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:43:43 2022] GET /compute/v2.1/servers/bac69e34-ec55-4f0b-8856-8411fe7ea17a => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:43:44.321067 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-3f8a7414-270f-4bb8-86dd-f587fcd6c6cd tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:43:44.321673 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-3f8a7414-270f-4bb8-86dd-f587fcd6c6cd tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:43:44.328932 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-3f8a7414-270f-4bb8-86dd-f587fcd6c6cd tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:44.337668 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-3f8a7414-270f-4bb8-86dd-f587fcd6c6cd tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:44.337668 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-3f8a7414-270f-4bb8-86dd-f587fcd6c6cd tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:44.337668 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-3f8a7414-270f-4bb8-86dd-f587fcd6c6cd tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:44.457913 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-3f8a7414-270f-4bb8-86dd-f587fcd6c6cd tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:44.465809 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-3f8a7414-270f-4bb8-86dd-f587fcd6c6cd tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:44.467290 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-3f8a7414-270f-4bb8-86dd-f587fcd6c6cd tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:44.468470 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-3f8a7414-270f-4bb8-86dd-f587fcd6c6cd tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1724 microversion: 2.20 time: 0.151373 Jun 07 14:43:44.469022 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 209/429] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:43:44 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:43:45.090571 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-111f5bda-a2df-4266-900f-0d80dea848fd tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:43:45.091181 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-111f5bda-a2df-4266-900f-0d80dea848fd tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: bac69e34-ec55-4f0b-8856-8411fe7ea17a] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:43:45.097707 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-111f5bda-a2df-4266-900f-0d80dea848fd tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:45.098148 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-111f5bda-a2df-4266-900f-0d80dea848fd tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:45.098902 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-111f5bda-a2df-4266-900f-0d80dea848fd tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:45.099428 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-111f5bda-a2df-4266-900f-0d80dea848fd tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:45.229681 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-111f5bda-a2df-4266-900f-0d80dea848fd tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15f5fa82414bdf8ca3f6723c0a8d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e877695d0f46339cb4b9b86aac3662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:45.237158 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-111f5bda-a2df-4266-900f-0d80dea848fd tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "GET /compute/v2.1/servers/bac69e34-ec55-4f0b-8856-8411fe7ea17a" status: 200 len: 1452 microversion: 2.1 time: 0.150954 Jun 07 14:43:45.237722 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 221/430] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:43:45 2022] GET /compute/v2.1/servers/bac69e34-ec55-4f0b-8856-8411fe7ea17a => generated 1452 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:43:45.253377 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-4b3489d4-8d31-43e8-bb48-f58651ce7eb4 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:43:45.253995 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-4b3489d4-8d31-43e8-bb48-f58651ce7eb4 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: bac69e34-ec55-4f0b-8856-8411fe7ea17a] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:43:45.260199 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-4b3489d4-8d31-43e8-bb48-f58651ce7eb4 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:45.260672 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-4b3489d4-8d31-43e8-bb48-f58651ce7eb4 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:45.261434 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-4b3489d4-8d31-43e8-bb48-f58651ce7eb4 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:45.261871 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-4b3489d4-8d31-43e8-bb48-f58651ce7eb4 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:45.394348 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-4b3489d4-8d31-43e8-bb48-f58651ce7eb4 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15f5fa82414bdf8ca3f6723c0a8d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e877695d0f46339cb4b9b86aac3662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:45.402024 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-4b3489d4-8d31-43e8-bb48-f58651ce7eb4 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "GET /compute/v2.1/servers/bac69e34-ec55-4f0b-8856-8411fe7ea17a" status: 200 len: 1452 microversion: 2.1 time: 0.152414 Jun 07 14:43:45.403311 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 210/431] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:43:45 2022] GET /compute/v2.1/servers/bac69e34-ec55-4f0b-8856-8411fe7ea17a => generated 1452 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:43:45.487035 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-adc36d61-6bd6-4f48-afc9-f3492d801c5d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:43:45.487648 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-adc36d61-6bd6-4f48-afc9-f3492d801c5d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:43:45.493572 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-adc36d61-6bd6-4f48-afc9-f3492d801c5d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:45.494028 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-adc36d61-6bd6-4f48-afc9-f3492d801c5d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:45.494798 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-adc36d61-6bd6-4f48-afc9-f3492d801c5d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:45.495241 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-adc36d61-6bd6-4f48-afc9-f3492d801c5d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:45.627930 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-adc36d61-6bd6-4f48-afc9-f3492d801c5d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:45.635971 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-adc36d61-6bd6-4f48-afc9-f3492d801c5d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:45.638105 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-adc36d61-6bd6-4f48-afc9-f3492d801c5d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:45.639390 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-adc36d61-6bd6-4f48-afc9-f3492d801c5d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1724 microversion: 2.20 time: 0.156097 Jun 07 14:43:45.649482 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 222/432] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:43:45 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:43:46.660062 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-49e4e210-168b-4342-a31e-4e27a36d5cef tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:43:46.660880 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-49e4e210-168b-4342-a31e-4e27a36d5cef tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:43:46.667643 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-49e4e210-168b-4342-a31e-4e27a36d5cef tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:46.668820 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-49e4e210-168b-4342-a31e-4e27a36d5cef tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:46.669824 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-49e4e210-168b-4342-a31e-4e27a36d5cef tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:46.670262 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-49e4e210-168b-4342-a31e-4e27a36d5cef tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:46.847976 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-49e4e210-168b-4342-a31e-4e27a36d5cef tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:46.856348 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-49e4e210-168b-4342-a31e-4e27a36d5cef tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:46.857996 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-49e4e210-168b-4342-a31e-4e27a36d5cef tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:46.859235 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-49e4e210-168b-4342-a31e-4e27a36d5cef tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1724 microversion: 2.20 time: 0.203318 Jun 07 14:43:46.859874 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 211/433] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:43:46 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1724 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:43:47.633497 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [req-412efb03-db21-4d8b-8c67-071d1151a3fe req-b72aacd3-852e-45d2-b23d-b87146574791 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bac69e34-ec55-4f0b-8856-8411fe7ea17a", "tag": "9c17af0a-e236-4760-ab4a-8f9ffaff1a14"}]} {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:43:47.642422 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [req-412efb03-db21-4d8b-8c67-071d1151a3fe req-b72aacd3-852e-45d2-b23d-b87146574791 service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:47.643199 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [req-412efb03-db21-4d8b-8c67-071d1151a3fe req-b72aacd3-852e-45d2-b23d-b87146574791 service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:47.655245 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.compute.server_external_events [req-412efb03-db21-4d8b-8c67-071d1151a3fe req-b72aacd3-852e-45d2-b23d-b87146574791 service nova] Creating event network-changed:9c17af0a-e236-4760-ab4a-8f9ffaff1a14 for instance bac69e34-ec55-4f0b-8856-8411fe7ea17a on hv-cinder-84497 Jun 07 14:43:47.660345 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [req-412efb03-db21-4d8b-8c67-071d1151a3fe req-b72aacd3-852e-45d2-b23d-b87146574791 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030475 Jun 07 14:43:47.661012 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 223/434] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jun 7 14:43:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:43:47.877646 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-9b64521b-3f06-4f41-9f60-2516186172a6 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:43:47.878334 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-9b64521b-3f06-4f41-9f60-2516186172a6 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:43:47.885258 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-9b64521b-3f06-4f41-9f60-2516186172a6 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:47.885713 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-9b64521b-3f06-4f41-9f60-2516186172a6 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:47.886485 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-9b64521b-3f06-4f41-9f60-2516186172a6 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:47.887533 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-9b64521b-3f06-4f41-9f60-2516186172a6 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:48.017302 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-9b64521b-3f06-4f41-9f60-2516186172a6 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:48.025854 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-9b64521b-3f06-4f41-9f60-2516186172a6 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:48.027359 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-9b64521b-3f06-4f41-9f60-2516186172a6 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:48.028543 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-9b64521b-3f06-4f41-9f60-2516186172a6 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1724 microversion: 2.20 time: 0.154919 Jun 07 14:43:48.029100 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 212/435] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:43:47 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:43:49.048039 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-eb116e5a-7581-4d6d-8260-d5feaba40c27 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:43:49.048771 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-eb116e5a-7581-4d6d-8260-d5feaba40c27 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:43:49.054966 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-eb116e5a-7581-4d6d-8260-d5feaba40c27 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:49.055416 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-eb116e5a-7581-4d6d-8260-d5feaba40c27 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:49.056186 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-eb116e5a-7581-4d6d-8260-d5feaba40c27 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:49.056690 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-eb116e5a-7581-4d6d-8260-d5feaba40c27 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:49.186091 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-eb116e5a-7581-4d6d-8260-d5feaba40c27 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:49.194320 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-eb116e5a-7581-4d6d-8260-d5feaba40c27 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:49.195822 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-eb116e5a-7581-4d6d-8260-d5feaba40c27 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:49.197000 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-eb116e5a-7581-4d6d-8260-d5feaba40c27 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1724 microversion: 2.20 time: 0.153811 Jun 07 14:43:49.197574 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 224/436] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:43:49 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:43:50.215837 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-fe95b966-942e-4e86-857b-603c730cddab tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:43:50.216492 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-fe95b966-942e-4e86-857b-603c730cddab tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:43:50.223022 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-fe95b966-942e-4e86-857b-603c730cddab tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:50.227633 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-fe95b966-942e-4e86-857b-603c730cddab tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:50.227633 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-fe95b966-942e-4e86-857b-603c730cddab tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:50.227633 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-fe95b966-942e-4e86-857b-603c730cddab tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:50.361689 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-fe95b966-942e-4e86-857b-603c730cddab tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:50.369709 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-fe95b966-942e-4e86-857b-603c730cddab tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:50.371809 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-fe95b966-942e-4e86-857b-603c730cddab tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:50.372985 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-fe95b966-942e-4e86-857b-603c730cddab tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1724 microversion: 2.20 time: 0.161155 Jun 07 14:43:50.373542 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 213/437] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:43:50 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:43:51.391631 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-a441c875-a7d2-4827-a181-588315633682 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:43:51.392305 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-a441c875-a7d2-4827-a181-588315633682 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:43:51.399383 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-a441c875-a7d2-4827-a181-588315633682 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:51.399837 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-a441c875-a7d2-4827-a181-588315633682 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:51.400645 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-a441c875-a7d2-4827-a181-588315633682 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:51.401086 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-a441c875-a7d2-4827-a181-588315633682 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:51.532405 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-a441c875-a7d2-4827-a181-588315633682 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:51.540422 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-a441c875-a7d2-4827-a181-588315633682 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:51.541919 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-a441c875-a7d2-4827-a181-588315633682 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:51.543066 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-a441c875-a7d2-4827-a181-588315633682 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1724 microversion: 2.20 time: 0.155914 Jun 07 14:43:51.543611 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 225/438] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:43:51 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:43:52.562566 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-7b158c3d-8bdc-4ebc-a05d-528215c933bf tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:43:52.563174 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-7b158c3d-8bdc-4ebc-a05d-528215c933bf tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:43:52.569823 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-7b158c3d-8bdc-4ebc-a05d-528215c933bf tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:52.570269 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-7b158c3d-8bdc-4ebc-a05d-528215c933bf tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:52.571033 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-7b158c3d-8bdc-4ebc-a05d-528215c933bf tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:52.571467 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-7b158c3d-8bdc-4ebc-a05d-528215c933bf tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:52.703630 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-7b158c3d-8bdc-4ebc-a05d-528215c933bf tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:52.711598 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-7b158c3d-8bdc-4ebc-a05d-528215c933bf tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:52.713121 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-7b158c3d-8bdc-4ebc-a05d-528215c933bf tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:52.714256 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-7b158c3d-8bdc-4ebc-a05d-528215c933bf tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1724 microversion: 2.20 time: 0.156216 Jun 07 14:43:52.714802 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 214/439] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:43:52 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:43:53.278445 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-62f80186-2699-48cf-ad3a-2f90ef21315d tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:43:53.278939 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-62f80186-2699-48cf-ad3a-2f90ef21315d tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] [instance: ac2c33a4-21c2-47b7-9a97-7e3d49c3653a] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:43:53.285529 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-62f80186-2699-48cf-ad3a-2f90ef21315d tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:53.286016 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-62f80186-2699-48cf-ad3a-2f90ef21315d tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:53.286853 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-62f80186-2699-48cf-ad3a-2f90ef21315d tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:53.287213 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-62f80186-2699-48cf-ad3a-2f90ef21315d tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:53.418435 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.objects.instance [None req-62f80186-2699-48cf-ad3a-2f90ef21315d tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lazy-loading 'services' on Instance uuid ac2c33a4-21c2-47b7-9a97-7e3d49c3653a {{(pid=118158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 14:43:53.671942 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-62f80186-2699-48cf-ad3a-2f90ef21315d tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] 10.222.0.85 "DELETE /compute/v2.1/servers/ac2c33a4-21c2-47b7-9a97-7e3d49c3653a/os-volume_attachments/5b6c7eef-67fe-49e1-a0ee-9d707d98e15c" status: 202 len: 0 microversion: 2.1 time: 0.397697 Jun 07 14:43:53.672564 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 226/440] 10.222.0.85 () {58 vars in 1415 bytes} [Tue Jun 7 14:43:53 2022] DELETE /compute/v2.1/servers/ac2c33a4-21c2-47b7-9a97-7e3d49c3653a/os-volume_attachments/5b6c7eef-67fe-49e1-a0ee-9d707d98e15c => generated 0 bytes in 399 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 14:43:53.735242 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-6c6e254a-9331-4521-b465-be71aff379b0 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:43:53.735242 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-6c6e254a-9331-4521-b465-be71aff379b0 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:43:53.740345 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-6c6e254a-9331-4521-b465-be71aff379b0 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:53.740834 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-6c6e254a-9331-4521-b465-be71aff379b0 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:53.741704 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-6c6e254a-9331-4521-b465-be71aff379b0 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:53.742146 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-6c6e254a-9331-4521-b465-be71aff379b0 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:53.880676 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-6c6e254a-9331-4521-b465-be71aff379b0 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:53.889636 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-6c6e254a-9331-4521-b465-be71aff379b0 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:53.891130 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-6c6e254a-9331-4521-b465-be71aff379b0 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:53.892277 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-6c6e254a-9331-4521-b465-be71aff379b0 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1724 microversion: 2.20 time: 0.163421 Jun 07 14:43:53.893158 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 215/441] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:43:53 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 14:43:54.912189 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-8924a3a0-15a6-47bd-a985-c55f89902d2f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:43:54.912911 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-8924a3a0-15a6-47bd-a985-c55f89902d2f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:43:54.919211 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-8924a3a0-15a6-47bd-a985-c55f89902d2f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:54.919655 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-8924a3a0-15a6-47bd-a985-c55f89902d2f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:54.920494 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-8924a3a0-15a6-47bd-a985-c55f89902d2f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:54.920934 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-8924a3a0-15a6-47bd-a985-c55f89902d2f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:55.061583 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-8924a3a0-15a6-47bd-a985-c55f89902d2f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:55.069740 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-8924a3a0-15a6-47bd-a985-c55f89902d2f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:55.071284 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-8924a3a0-15a6-47bd-a985-c55f89902d2f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:55.072406 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-8924a3a0-15a6-47bd-a985-c55f89902d2f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1724 microversion: 2.20 time: 0.164922 Jun 07 14:43:55.072948 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 227/442] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:43:54 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 14:43:55.851745 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-732a2c70-bfa4-4cee-85c3-c65c9ede87d3 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:43:55.853655 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-732a2c70-bfa4-4cee-85c3-c65c9ede87d3 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] [instance: ac2c33a4-21c2-47b7-9a97-7e3d49c3653a] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:43:55.859005 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-732a2c70-bfa4-4cee-85c3-c65c9ede87d3 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:55.859461 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-732a2c70-bfa4-4cee-85c3-c65c9ede87d3 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:55.860233 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-732a2c70-bfa4-4cee-85c3-c65c9ede87d3 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:55.860714 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-732a2c70-bfa4-4cee-85c3-c65c9ede87d3 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:55.885869 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-732a2c70-bfa4-4cee-85c3-c65c9ede87d3 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] [instance: ac2c33a4-21c2-47b7-9a97-7e3d49c3653a] Going to try to terminate instance {{(pid=118157) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 14:43:56.095451 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-259bcca1-e673-4077-b015-cfdba685cb29 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:43:56.095988 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-259bcca1-e673-4077-b015-cfdba685cb29 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:43:56.102620 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-259bcca1-e673-4077-b015-cfdba685cb29 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:56.108184 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-259bcca1-e673-4077-b015-cfdba685cb29 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:56.108184 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-259bcca1-e673-4077-b015-cfdba685cb29 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:56.108184 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-259bcca1-e673-4077-b015-cfdba685cb29 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:56.196437 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-732a2c70-bfa4-4cee-85c3-c65c9ede87d3 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] 10.222.0.85 "DELETE /compute/v2.1/servers/ac2c33a4-21c2-47b7-9a97-7e3d49c3653a" status: 204 len: 0 microversion: 2.1 time: 0.348132 Jun 07 14:43:56.203340 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 216/443] 10.222.0.85 () {58 vars in 1238 bytes} [Tue Jun 7 14:43:55 2022] DELETE /compute/v2.1/servers/ac2c33a4-21c2-47b7-9a97-7e3d49c3653a => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 14:43:56.206107 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-3d19d335-9d10-42e8-884a-db604b762e57 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:43:56.206848 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-3d19d335-9d10-42e8-884a-db604b762e57 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] [instance: ac2c33a4-21c2-47b7-9a97-7e3d49c3653a] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:43:56.212798 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-3d19d335-9d10-42e8-884a-db604b762e57 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:56.213250 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-3d19d335-9d10-42e8-884a-db604b762e57 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:56.214024 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-3d19d335-9d10-42e8-884a-db604b762e57 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:56.214462 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-3d19d335-9d10-42e8-884a-db604b762e57 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:56.238240 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-259bcca1-e673-4077-b015-cfdba685cb29 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:56.246969 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-259bcca1-e673-4077-b015-cfdba685cb29 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:56.248492 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-259bcca1-e673-4077-b015-cfdba685cb29 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:56.249656 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-259bcca1-e673-4077-b015-cfdba685cb29 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1724 microversion: 2.20 time: 0.158184 Jun 07 14:43:56.250415 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 228/444] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:43:56 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:43:56.350686 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-3d19d335-9d10-42e8-884a-db604b762e57 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a605008cb5474f168f572fd0a9e71193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634574e706ee4f31bf4446871f11d5e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:56.361648 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-3d19d335-9d10-42e8-884a-db604b762e57 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] 10.222.0.85 "GET /compute/v2.1/servers/ac2c33a4-21c2-47b7-9a97-7e3d49c3653a" status: 200 len: 1512 microversion: 2.1 time: 0.159496 Jun 07 14:43:56.362227 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 217/445] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:43:56 2022] GET /compute/v2.1/servers/ac2c33a4-21c2-47b7-9a97-7e3d49c3653a => generated 1512 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:43:57.268186 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-3d3b3876-ec17-43e5-ae8f-27effa5d848b tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:43:57.268768 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-3d3b3876-ec17-43e5-ae8f-27effa5d848b tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:43:57.275204 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-3d3b3876-ec17-43e5-ae8f-27effa5d848b tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:57.275642 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-3d3b3876-ec17-43e5-ae8f-27effa5d848b tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:57.276420 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-3d3b3876-ec17-43e5-ae8f-27effa5d848b tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:57.276855 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-3d3b3876-ec17-43e5-ae8f-27effa5d848b tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:57.379630 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-d0ceee0c-c8db-4bee-b3f0-0e831bfab0dd tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:43:57.380339 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-d0ceee0c-c8db-4bee-b3f0-0e831bfab0dd tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] [instance: ac2c33a4-21c2-47b7-9a97-7e3d49c3653a] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:43:57.382870 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG dbcounter [-] [118157] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=118157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:43:57.387681 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-d0ceee0c-c8db-4bee-b3f0-0e831bfab0dd tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:57.388126 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-d0ceee0c-c8db-4bee-b3f0-0e831bfab0dd tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:57.389574 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-d0ceee0c-c8db-4bee-b3f0-0e831bfab0dd tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:57.390010 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-d0ceee0c-c8db-4bee-b3f0-0e831bfab0dd tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:57.415036 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-3d3b3876-ec17-43e5-ae8f-27effa5d848b tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:57.423530 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-3d3b3876-ec17-43e5-ae8f-27effa5d848b tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:57.425134 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-3d3b3876-ec17-43e5-ae8f-27effa5d848b tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:57.426297 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-3d3b3876-ec17-43e5-ae8f-27effa5d848b tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1724 microversion: 2.20 time: 0.162276 Jun 07 14:43:57.426860 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 229/446] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:43:57 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:43:57.518743 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-d0ceee0c-c8db-4bee-b3f0-0e831bfab0dd tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a605008cb5474f168f572fd0a9e71193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634574e706ee4f31bf4446871f11d5e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:57.526162 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-d0ceee0c-c8db-4bee-b3f0-0e831bfab0dd tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] 10.222.0.85 "GET /compute/v2.1/servers/ac2c33a4-21c2-47b7-9a97-7e3d49c3653a" status: 200 len: 1512 microversion: 2.1 time: 0.150383 Jun 07 14:43:57.526718 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 218/447] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:43:57 2022] GET /compute/v2.1/servers/ac2c33a4-21c2-47b7-9a97-7e3d49c3653a => generated 1512 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:43:58.450203 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-1e1d89f0-6b99-4156-a759-4e20b27c36fa tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:43:58.450822 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-1e1d89f0-6b99-4156-a759-4e20b27c36fa tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:43:58.458039 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-1e1d89f0-6b99-4156-a759-4e20b27c36fa tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:58.458555 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-1e1d89f0-6b99-4156-a759-4e20b27c36fa tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:58.459329 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-1e1d89f0-6b99-4156-a759-4e20b27c36fa tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:58.459769 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-1e1d89f0-6b99-4156-a759-4e20b27c36fa tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:58.543094 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-e59a4f8c-8b0f-4b73-86e6-726e963b4712 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:43:58.543710 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-e59a4f8c-8b0f-4b73-86e6-726e963b4712 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] [instance: ac2c33a4-21c2-47b7-9a97-7e3d49c3653a] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:43:58.550257 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-e59a4f8c-8b0f-4b73-86e6-726e963b4712 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:58.550707 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-e59a4f8c-8b0f-4b73-86e6-726e963b4712 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:58.551478 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-e59a4f8c-8b0f-4b73-86e6-726e963b4712 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:58.551916 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-e59a4f8c-8b0f-4b73-86e6-726e963b4712 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:58.685070 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-1e1d89f0-6b99-4156-a759-4e20b27c36fa tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:58.694502 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-1e1d89f0-6b99-4156-a759-4e20b27c36fa tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:58.695840 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-e59a4f8c-8b0f-4b73-86e6-726e963b4712 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a605008cb5474f168f572fd0a9e71193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634574e706ee4f31bf4446871f11d5e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:58.696214 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-1e1d89f0-6b99-4156-a759-4e20b27c36fa tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:58.697631 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-1e1d89f0-6b99-4156-a759-4e20b27c36fa tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1724 microversion: 2.20 time: 0.251410 Jun 07 14:43:58.710153 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-e59a4f8c-8b0f-4b73-86e6-726e963b4712 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] 10.222.0.85 "GET /compute/v2.1/servers/ac2c33a4-21c2-47b7-9a97-7e3d49c3653a" status: 200 len: 1512 microversion: 2.1 time: 0.164401 Jun 07 14:43:58.710153 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 219/448] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:43:58 2022] GET /compute/v2.1/servers/ac2c33a4-21c2-47b7-9a97-7e3d49c3653a => generated 1512 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:43:58.710499 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 230/449] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:43:58 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1724 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:43:59.026745 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [req-b1df4907-47bf-48bf-85c8-c7ced7d54f19 req-e4cee758-70fd-4a19-92fd-ebcdf9833908 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac2c33a4-21c2-47b7-9a97-7e3d49c3653a", "name": "network-vif-deleted", "tag": "e7624cd4-c440-4235-8255-0296b7b68288"}]} {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:43:59.035698 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [req-b1df4907-47bf-48bf-85c8-c7ced7d54f19 req-e4cee758-70fd-4a19-92fd-ebcdf9833908 service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:59.036143 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [req-b1df4907-47bf-48bf-85c8-c7ced7d54f19 req-e4cee758-70fd-4a19-92fd-ebcdf9833908 service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:59.040170 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG dbcounter [-] [118157] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:43:59.056677 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.compute.server_external_events [req-b1df4907-47bf-48bf-85c8-c7ced7d54f19 req-e4cee758-70fd-4a19-92fd-ebcdf9833908 service nova] Creating event network-vif-deleted:e7624cd4-c440-4235-8255-0296b7b68288 for instance ac2c33a4-21c2-47b7-9a97-7e3d49c3653a on hv-cinder-84497 Jun 07 14:43:59.064475 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [req-b1df4907-47bf-48bf-85c8-c7ced7d54f19 req-e4cee758-70fd-4a19-92fd-ebcdf9833908 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041126 Jun 07 14:43:59.070921 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 220/450] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jun 7 14:43:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:43:59.715757 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-5a1f1181-3778-4d6c-9bb9-4ee67350d337 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:43:59.716390 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-5a1f1181-3778-4d6c-9bb9-4ee67350d337 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:43:59.724977 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-b4b49ba9-4452-4419-9485-07428e299f27 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:43:59.725782 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-b4b49ba9-4452-4419-9485-07428e299f27 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] [instance: ac2c33a4-21c2-47b7-9a97-7e3d49c3653a] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:43:59.729611 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5a1f1181-3778-4d6c-9bb9-4ee67350d337 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:59.730128 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5a1f1181-3778-4d6c-9bb9-4ee67350d337 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:59.730912 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5a1f1181-3778-4d6c-9bb9-4ee67350d337 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:59.731353 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5a1f1181-3778-4d6c-9bb9-4ee67350d337 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:59.732944 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-b4b49ba9-4452-4419-9485-07428e299f27 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:59.733399 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-b4b49ba9-4452-4419-9485-07428e299f27 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:59.734173 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-b4b49ba9-4452-4419-9485-07428e299f27 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:59.734610 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-b4b49ba9-4452-4419-9485-07428e299f27 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:59.770324 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-b4b49ba9-4452-4419-9485-07428e299f27 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:43:59.770771 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-b4b49ba9-4452-4419-9485-07428e299f27 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:43:59.771229 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.objects.instance [None req-b4b49ba9-4452-4419-9485-07428e299f27 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lazy-loading 'fault' on Instance uuid ac2c33a4-21c2-47b7-9a97-7e3d49c3653a {{(pid=118157) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 14:43:59.818793 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-b4b49ba9-4452-4419-9485-07428e299f27 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a605008cb5474f168f572fd0a9e71193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634574e706ee4f31bf4446871f11d5e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:59.826405 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-b4b49ba9-4452-4419-9485-07428e299f27 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] 10.222.0.85 "GET /compute/v2.1/servers/ac2c33a4-21c2-47b7-9a97-7e3d49c3653a" status: 200 len: 1308 microversion: 2.1 time: 0.106316 Jun 07 14:43:59.827807 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 221/451] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:43:59 2022] GET /compute/v2.1/servers/ac2c33a4-21c2-47b7-9a97-7e3d49c3653a => generated 1308 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:43:59.868603 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-5a1f1181-3778-4d6c-9bb9-4ee67350d337 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:59.872101 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG dbcounter [-] [118158] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:43:59.877780 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-5a1f1181-3778-4d6c-9bb9-4ee67350d337 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:59.879274 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-5a1f1181-3778-4d6c-9bb9-4ee67350d337 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:43:59.880445 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-5a1f1181-3778-4d6c-9bb9-4ee67350d337 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1745 microversion: 2.20 time: 0.168725 Jun 07 14:43:59.890455 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 231/452] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:43:59 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1745 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:44:00.844777 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-b30c080f-9db5-49d0-bc1e-f20dc2a8388c tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:44:00.845431 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-b30c080f-9db5-49d0-bc1e-f20dc2a8388c tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] [instance: ac2c33a4-21c2-47b7-9a97-7e3d49c3653a] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:44:00.851988 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-b30c080f-9db5-49d0-bc1e-f20dc2a8388c tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:00.852468 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-b30c080f-9db5-49d0-bc1e-f20dc2a8388c tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:00.853228 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-b30c080f-9db5-49d0-bc1e-f20dc2a8388c tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:00.853660 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-b30c080f-9db5-49d0-bc1e-f20dc2a8388c tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:00.866613 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.wsgi [None req-b30c080f-9db5-49d0-bc1e-f20dc2a8388c tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] HTTP exception thrown: Instance ac2c33a4-21c2-47b7-9a97-7e3d49c3653a could not be found. Jun 07 14:44:00.868213 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-b30c080f-9db5-49d0-bc1e-f20dc2a8388c tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Request method failure captured: Jun 07 14:44:00.868213 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: request: GET /compute/v2.1/servers/ac2c33a4-21c2-47b7-9a97-7e3d49c3653a HTTP/1.1 Jun 07 14:44:00.868213 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Accept: application/json Jun 07 14:44:00.868213 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Accept-Encoding: identity Jun 07 14:44:00.868213 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Connection: close Jun 07 14:44:00.868213 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Content-Length: 0 Jun 07 14:44:00.868213 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Content-Type: application/json Jun 07 14:44:00.868213 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Host: 10.222.0.85 Jun 07 14:44:00.868213 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Openstack-System-Scope: None Jun 07 14:44:00.868213 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: User-Agent: python-urllib3/1.26.9 Jun 07 14:44:00.868213 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Auth-Token: gAAAAABin2POQAo9iuMxPLtludRtLnl5En_vN9SacRCtpaq0i4t5Rist1SnD-PjHswAImXPBhoNjtaA4rIxEkWAJfWvU24MTViaivZ_ip19g84I0JrsF9Icl-cQVwoo1OG-SGo3zhadGZXjGXGLXx46ZwP-nbbpHx8rvrxfvfZw0N8_vQG6kzqc Jun 07 14:44:00.868213 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Domain-Id: None Jun 07 14:44:00.868213 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Domain-Name: None Jun 07 14:44:00.868213 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Identity-Status: Confirmed Jun 07 14:44:00.868213 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Is-Admin-Project: True Jun 07 14:44:00.868213 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Project-Domain-Id: default Jun 07 14:44:00.868213 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Project-Domain-Name: Default Jun 07 14:44:00.868213 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Project-Id: 634574e706ee4f31bf4446871f11d5e0 Jun 07 14:44:00.868213 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2005701616 Jun 07 14:44:00.868213 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Role: member,reader Jun 07 14:44:00.868213 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Roles: member,reader Jun 07 14:44:00.869933 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/634574e706ee4f31bf4446871f11d5e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_634574e706ee4f31bf4446871f11d5e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/634574e706ee4f31bf4446871f11d5e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/634574e706ee4f31bf4446871f11d5e0"}]}] Jun 07 14:44:00.869933 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Tenant: tempest-VolumesSnapshotTestJSON-2005701616 Jun 07 14:44:00.869933 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Tenant-Id: 634574e706ee4f31bf4446871f11d5e0 Jun 07 14:44:00.869933 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2005701616 Jun 07 14:44:00.869933 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User: tempest-VolumesSnapshotTestJSON-2005701616-project Jun 07 14:44:00.869933 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User-Domain-Id: default Jun 07 14:44:00.869933 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User-Domain-Name: Default Jun 07 14:44:00.869933 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User-Id: a605008cb5474f168f572fd0a9e71193 Jun 07 14:44:00.869933 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User-Name: tempest-VolumesSnapshotTestJSON-2005701616-project Jun 07 14:44:00.869933 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: method: > Jun 07 14:44:00.869933 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: exception: Instance ac2c33a4-21c2-47b7-9a97-7e3d49c3653a could not be found. Jun 07 14:44:00.869933 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: action_args: {'id': 'ac2c33a4-21c2-47b7-9a97-7e3d49c3653a'} Jun 07 14:44:00.870794 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:44:00.870794 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:44:00.870794 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 14:44:00.870794 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 14:44:00.870794 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 14:44:00.870794 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 14:44:00.870794 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 14:44:00.870794 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 14:44:00.870794 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 14:44:00.870794 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 14:44:00.870794 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac2c33a4-21c2-47b7-9a97-7e3d49c3653a could not be found. Jun 07 14:44:00.870794 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:44:00.870794 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:44:00.870794 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:44:00.870794 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:44:00.870794 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:44:00.870794 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:44:00.870794 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:44:00.870794 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:44:00.870794 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:44:00.872258 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:44:00.872258 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 14:44:00.872258 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 14:44:00.872258 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 14:44:00.872258 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 14:44:00.872258 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 14:44:00.872258 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:44:00.872258 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac2c33a4-21c2-47b7-9a97-7e3d49c3653a could not be found. Jun 07 14:44:00.872258 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:44:00.872258 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:44:00.872258 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:44:00.872258 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:44:00.872258 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:44:00.872258 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:44:00.872258 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:44:00.872258 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:44:00.872258 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac2c33a4-21c2-47b7-9a97-7e3d49c3653a could not be found. Jun 07 14:44:00.872258 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:44:00.874117 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-b30c080f-9db5-49d0-bc1e-f20dc2a8388c tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Returning 404 to user: Instance ac2c33a4-21c2-47b7-9a97-7e3d49c3653a could not be found. {{(pid=118157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:44:00.874117 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-b30c080f-9db5-49d0-bc1e-f20dc2a8388c tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] 10.222.0.85 "GET /compute/v2.1/servers/ac2c33a4-21c2-47b7-9a97-7e3d49c3653a" status: 404 len: 111 microversion: 2.1 time: 0.029031 Jun 07 14:44:00.874117 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 222/453] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:44:00 2022] GET /compute/v2.1/servers/ac2c33a4-21c2-47b7-9a97-7e3d49c3653a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 14:44:00.906801 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-d8ecf2e5-3780-4b6e-883c-4f3d1d4ded65 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:44:00.907408 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-d8ecf2e5-3780-4b6e-883c-4f3d1d4ded65 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:44:00.909832 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG dbcounter [-] [118158] Writing DB stats nova_api:SELECT=44 {{(pid=118158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:44:00.914800 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-d8ecf2e5-3780-4b6e-883c-4f3d1d4ded65 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:00.915314 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-d8ecf2e5-3780-4b6e-883c-4f3d1d4ded65 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:00.917945 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-d8ecf2e5-3780-4b6e-883c-4f3d1d4ded65 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:00.917945 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-d8ecf2e5-3780-4b6e-883c-4f3d1d4ded65 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:01.050622 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-d8ecf2e5-3780-4b6e-883c-4f3d1d4ded65 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:01.058504 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-d8ecf2e5-3780-4b6e-883c-4f3d1d4ded65 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:01.059984 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-d8ecf2e5-3780-4b6e-883c-4f3d1d4ded65 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:01.061926 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-d8ecf2e5-3780-4b6e-883c-4f3d1d4ded65 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1745 microversion: 2.20 time: 0.158542 Jun 07 14:44:01.062735 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 232/454] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:44:00 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1745 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:44:02.081075 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-e73c7552-768a-4711-8b7a-86625e5bf35b tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:44:02.081613 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-e73c7552-768a-4711-8b7a-86625e5bf35b tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:44:02.088154 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-e73c7552-768a-4711-8b7a-86625e5bf35b tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:02.088647 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-e73c7552-768a-4711-8b7a-86625e5bf35b tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:02.089392 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-e73c7552-768a-4711-8b7a-86625e5bf35b tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:02.089817 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-e73c7552-768a-4711-8b7a-86625e5bf35b tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:02.219444 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-e73c7552-768a-4711-8b7a-86625e5bf35b tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:02.227424 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-e73c7552-768a-4711-8b7a-86625e5bf35b tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:02.228955 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-e73c7552-768a-4711-8b7a-86625e5bf35b tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:02.230100 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-e73c7552-768a-4711-8b7a-86625e5bf35b tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1745 microversion: 2.20 time: 0.153471 Jun 07 14:44:02.230640 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 223/455] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:44:02 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:44:03.249852 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-65ded355-5163-4d26-9bdc-d9b9e7e6d9a3 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:44:03.250700 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-65ded355-5163-4d26-9bdc-d9b9e7e6d9a3 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:44:03.257517 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-65ded355-5163-4d26-9bdc-d9b9e7e6d9a3 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:03.257972 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-65ded355-5163-4d26-9bdc-d9b9e7e6d9a3 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:03.258744 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-65ded355-5163-4d26-9bdc-d9b9e7e6d9a3 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:03.259175 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-65ded355-5163-4d26-9bdc-d9b9e7e6d9a3 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:03.391226 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-65ded355-5163-4d26-9bdc-d9b9e7e6d9a3 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:03.399800 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-65ded355-5163-4d26-9bdc-d9b9e7e6d9a3 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:03.401327 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-65ded355-5163-4d26-9bdc-d9b9e7e6d9a3 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:03.402921 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-65ded355-5163-4d26-9bdc-d9b9e7e6d9a3 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1745 microversion: 2.20 time: 0.157049 Jun 07 14:44:03.403342 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 233/456] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:44:03 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:44:04.421708 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-83581d75-3383-48ce-b532-ebbe998b1ddf tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:44:04.425721 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-83581d75-3383-48ce-b532-ebbe998b1ddf tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:44:04.428888 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-83581d75-3383-48ce-b532-ebbe998b1ddf tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:04.429429 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-83581d75-3383-48ce-b532-ebbe998b1ddf tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:04.430199 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-83581d75-3383-48ce-b532-ebbe998b1ddf tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:04.430638 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-83581d75-3383-48ce-b532-ebbe998b1ddf tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:04.558998 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-83581d75-3383-48ce-b532-ebbe998b1ddf tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:04.566922 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-83581d75-3383-48ce-b532-ebbe998b1ddf tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:04.568452 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-83581d75-3383-48ce-b532-ebbe998b1ddf tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:04.569602 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-83581d75-3383-48ce-b532-ebbe998b1ddf tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1745 microversion: 2.20 time: 0.151970 Jun 07 14:44:04.570140 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 224/457] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:44:04 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1745 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:44:05.588279 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-6a2fc7e9-8636-4afa-b5a0-b0a04277af48 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:44:05.588911 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-6a2fc7e9-8636-4afa-b5a0-b0a04277af48 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:44:05.595351 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-6a2fc7e9-8636-4afa-b5a0-b0a04277af48 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:05.595794 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-6a2fc7e9-8636-4afa-b5a0-b0a04277af48 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:05.596577 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-6a2fc7e9-8636-4afa-b5a0-b0a04277af48 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:05.597009 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-6a2fc7e9-8636-4afa-b5a0-b0a04277af48 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:05.724058 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-6a2fc7e9-8636-4afa-b5a0-b0a04277af48 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:05.732597 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-6a2fc7e9-8636-4afa-b5a0-b0a04277af48 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:05.733968 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-6a2fc7e9-8636-4afa-b5a0-b0a04277af48 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:05.735261 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-6a2fc7e9-8636-4afa-b5a0-b0a04277af48 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1745 microversion: 2.20 time: 0.150837 Jun 07 14:44:05.735817 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 234/458] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:44:05 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1745 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:44:06.754378 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-640dfbdd-cea2-4b5a-aa04-8efb61ac8574 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:44:06.754989 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-640dfbdd-cea2-4b5a-aa04-8efb61ac8574 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:44:06.761632 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-640dfbdd-cea2-4b5a-aa04-8efb61ac8574 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:06.762077 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-640dfbdd-cea2-4b5a-aa04-8efb61ac8574 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:06.762844 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-640dfbdd-cea2-4b5a-aa04-8efb61ac8574 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:06.763278 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-640dfbdd-cea2-4b5a-aa04-8efb61ac8574 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:06.891039 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-640dfbdd-cea2-4b5a-aa04-8efb61ac8574 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:06.899768 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-640dfbdd-cea2-4b5a-aa04-8efb61ac8574 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:06.901419 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-640dfbdd-cea2-4b5a-aa04-8efb61ac8574 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:06.902558 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-640dfbdd-cea2-4b5a-aa04-8efb61ac8574 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1745 microversion: 2.20 time: 0.152731 Jun 07 14:44:06.903098 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 225/459] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:44:06 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:44:07.921064 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-2fd3e337-4662-4455-94fd-3c2039bd9b5d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:44:07.921678 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-2fd3e337-4662-4455-94fd-3c2039bd9b5d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:44:07.928871 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-2fd3e337-4662-4455-94fd-3c2039bd9b5d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:07.929322 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-2fd3e337-4662-4455-94fd-3c2039bd9b5d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:07.930102 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-2fd3e337-4662-4455-94fd-3c2039bd9b5d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:07.930539 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-2fd3e337-4662-4455-94fd-3c2039bd9b5d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:08.059431 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-2fd3e337-4662-4455-94fd-3c2039bd9b5d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:08.067363 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-2fd3e337-4662-4455-94fd-3c2039bd9b5d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:08.068919 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-2fd3e337-4662-4455-94fd-3c2039bd9b5d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:08.070068 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-2fd3e337-4662-4455-94fd-3c2039bd9b5d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1745 microversion: 2.20 time: 0.152957 Jun 07 14:44:08.070626 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 235/460] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:44:07 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:44:08.304998 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [req-aa9359f3-d2ce-455a-b9fc-1aedf11864d3 req-0c4e6cb0-a62d-4e9f-a1a8-e9026b45439b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8a8352c-4f05-4640-a976-edb025819089", "name": "network-vif-plugged", "status": "completed", "tag": "557a43fa-c7ca-47d0-9a4b-fe35626e8941"}]} {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:44:08.314687 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [req-aa9359f3-d2ce-455a-b9fc-1aedf11864d3 req-0c4e6cb0-a62d-4e9f-a1a8-e9026b45439b service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:08.314687 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [req-aa9359f3-d2ce-455a-b9fc-1aedf11864d3 req-0c4e6cb0-a62d-4e9f-a1a8-e9026b45439b service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:08.325774 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.compute.server_external_events [req-aa9359f3-d2ce-455a-b9fc-1aedf11864d3 req-0c4e6cb0-a62d-4e9f-a1a8-e9026b45439b service nova] Creating event network-vif-plugged:557a43fa-c7ca-47d0-9a4b-fe35626e8941 for instance a8a8352c-4f05-4640-a976-edb025819089 on hv-cinder-84497 Jun 07 14:44:08.330745 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [req-aa9359f3-d2ce-455a-b9fc-1aedf11864d3 req-0c4e6cb0-a62d-4e9f-a1a8-e9026b45439b service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030630 Jun 07 14:44:08.331924 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 226/461] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jun 7 14:44:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:44:09.088731 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-51d9f43c-2309-4b00-93a2-bd6d9919296d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:44:09.089347 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-51d9f43c-2309-4b00-93a2-bd6d9919296d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:44:09.095923 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-51d9f43c-2309-4b00-93a2-bd6d9919296d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:09.096396 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-51d9f43c-2309-4b00-93a2-bd6d9919296d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:09.097179 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-51d9f43c-2309-4b00-93a2-bd6d9919296d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:09.099364 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-51d9f43c-2309-4b00-93a2-bd6d9919296d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:09.237326 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-51d9f43c-2309-4b00-93a2-bd6d9919296d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:09.245976 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-51d9f43c-2309-4b00-93a2-bd6d9919296d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:09.247635 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-51d9f43c-2309-4b00-93a2-bd6d9919296d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:09.248808 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-51d9f43c-2309-4b00-93a2-bd6d9919296d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1745 microversion: 2.20 time: 0.164063 Jun 07 14:44:09.249353 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 236/462] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:44:09 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1745 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:44:10.267732 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-e2c72c47-db5d-4484-bca6-710315c651d2 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:44:10.268735 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-e2c72c47-db5d-4484-bca6-710315c651d2 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:44:10.275469 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-e2c72c47-db5d-4484-bca6-710315c651d2 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:10.275921 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-e2c72c47-db5d-4484-bca6-710315c651d2 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:10.276759 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-e2c72c47-db5d-4484-bca6-710315c651d2 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:10.277205 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-e2c72c47-db5d-4484-bca6-710315c651d2 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:10.413623 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-e2c72c47-db5d-4484-bca6-710315c651d2 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:10.421607 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-e2c72c47-db5d-4484-bca6-710315c651d2 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:10.423098 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-e2c72c47-db5d-4484-bca6-710315c651d2 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:10.424275 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-e2c72c47-db5d-4484-bca6-710315c651d2 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1745 microversion: 2.20 time: 0.161465 Jun 07 14:44:10.424847 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 227/463] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:44:10 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1745 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:44:11.443497 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-ec3823f0-3d17-4602-9b97-b58ccd1a1c8e tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:44:11.444988 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-ec3823f0-3d17-4602-9b97-b58ccd1a1c8e tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:44:11.452874 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-ec3823f0-3d17-4602-9b97-b58ccd1a1c8e tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:11.455758 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-ec3823f0-3d17-4602-9b97-b58ccd1a1c8e tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:11.455758 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-ec3823f0-3d17-4602-9b97-b58ccd1a1c8e tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:11.455758 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-ec3823f0-3d17-4602-9b97-b58ccd1a1c8e tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:11.614837 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-ec3823f0-3d17-4602-9b97-b58ccd1a1c8e tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:11.623637 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-ec3823f0-3d17-4602-9b97-b58ccd1a1c8e tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:11.625968 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-ec3823f0-3d17-4602-9b97-b58ccd1a1c8e tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:11.627419 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-ec3823f0-3d17-4602-9b97-b58ccd1a1c8e tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1740 microversion: 2.20 time: 0.188766 Jun 07 14:44:11.628214 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 237/464] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:44:11 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1740 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:44:12.648814 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-25ad55e8-5aa8-46ab-9bb8-4befbf5fa153 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:44:12.650369 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-25ad55e8-5aa8-46ab-9bb8-4befbf5fa153 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:44:12.657261 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-25ad55e8-5aa8-46ab-9bb8-4befbf5fa153 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:12.657919 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-25ad55e8-5aa8-46ab-9bb8-4befbf5fa153 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:12.658861 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-25ad55e8-5aa8-46ab-9bb8-4befbf5fa153 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:12.659287 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-25ad55e8-5aa8-46ab-9bb8-4befbf5fa153 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:12.799495 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-25ad55e8-5aa8-46ab-9bb8-4befbf5fa153 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:12.809121 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-25ad55e8-5aa8-46ab-9bb8-4befbf5fa153 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:12.810718 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-25ad55e8-5aa8-46ab-9bb8-4befbf5fa153 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:12.811904 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-25ad55e8-5aa8-46ab-9bb8-4befbf5fa153 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1740 microversion: 2.20 time: 0.167091 Jun 07 14:44:12.812456 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 228/465] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:44:12 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1740 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:44:13.831098 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-25bee468-6ab8-4f37-90e2-c855e35c1be3 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:44:13.832484 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-25bee468-6ab8-4f37-90e2-c855e35c1be3 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:44:13.840083 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-25bee468-6ab8-4f37-90e2-c855e35c1be3 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:13.840567 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-25bee468-6ab8-4f37-90e2-c855e35c1be3 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:13.841343 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-25bee468-6ab8-4f37-90e2-c855e35c1be3 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:13.841774 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-25bee468-6ab8-4f37-90e2-c855e35c1be3 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:13.997610 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-25bee468-6ab8-4f37-90e2-c855e35c1be3 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:14.007242 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-25bee468-6ab8-4f37-90e2-c855e35c1be3 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:14.009071 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-25bee468-6ab8-4f37-90e2-c855e35c1be3 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:14.010359 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-25bee468-6ab8-4f37-90e2-c855e35c1be3 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1740 microversion: 2.20 time: 0.183176 Jun 07 14:44:14.010953 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 238/466] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:44:13 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1740 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:44:15.029490 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-bee58d35-02e4-40f4-8bfb-275faf6287ee tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:44:15.030951 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-bee58d35-02e4-40f4-8bfb-275faf6287ee tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:44:15.037740 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-bee58d35-02e4-40f4-8bfb-275faf6287ee tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:15.038181 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-bee58d35-02e4-40f4-8bfb-275faf6287ee tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:15.039166 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-bee58d35-02e4-40f4-8bfb-275faf6287ee tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:15.039768 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-bee58d35-02e4-40f4-8bfb-275faf6287ee tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:15.205554 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-bee58d35-02e4-40f4-8bfb-275faf6287ee tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:15.220744 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-bee58d35-02e4-40f4-8bfb-275faf6287ee tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:15.224091 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-bee58d35-02e4-40f4-8bfb-275faf6287ee tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:15.225907 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-bee58d35-02e4-40f4-8bfb-275faf6287ee tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1740 microversion: 2.20 time: 0.200391 Jun 07 14:44:15.226900 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 229/467] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:44:15 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1740 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:44:16.266296 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-4c63301c-dfe8-4fd7-af04-3dc0827e1067 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:44:16.266903 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-4c63301c-dfe8-4fd7-af04-3dc0827e1067 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:44:16.274187 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-4c63301c-dfe8-4fd7-af04-3dc0827e1067 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:16.274639 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-4c63301c-dfe8-4fd7-af04-3dc0827e1067 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:16.275412 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-4c63301c-dfe8-4fd7-af04-3dc0827e1067 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:16.275850 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-4c63301c-dfe8-4fd7-af04-3dc0827e1067 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:16.496491 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-4c63301c-dfe8-4fd7-af04-3dc0827e1067 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:16.505186 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-4c63301c-dfe8-4fd7-af04-3dc0827e1067 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:16.506696 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-4c63301c-dfe8-4fd7-af04-3dc0827e1067 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:16.507867 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-4c63301c-dfe8-4fd7-af04-3dc0827e1067 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1740 microversion: 2.20 time: 0.245366 Jun 07 14:44:16.508819 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 239/468] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:44:16 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1740 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:44:16.614070 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-fa3e635f-7157-4dbb-94a4-ac30f88164bd tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1746229382", "imageRef": "7802ce25-d370-43a3-8d85-0257d644d539", "flavorRef": "452", "networks": [{"uuid": "ba704a6c-938d-40c0-bc6b-572841c7cd32"}]}} {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:44:16.886167 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.network.neutron [None req-fa3e635f-7157-4dbb-94a4-ac30f88164bd tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] validate_networks() for [('ba704a6c-938d-40c0-bc6b-572841c7cd32', None, None, None, None, None)] {{(pid=118157) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 14:44:17.342496 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.virt.hardware [None req-fa3e635f-7157-4dbb-94a4-ac30f88164bd tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Flavor limits 0:0:0 {{(pid=118157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 14:44:17.342994 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.virt.hardware [None req-fa3e635f-7157-4dbb-94a4-ac30f88164bd tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Image limits 0:0:0 {{(pid=118157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 14:44:17.343482 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.virt.hardware [None req-fa3e635f-7157-4dbb-94a4-ac30f88164bd tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Flavor pref 0:0:0 {{(pid=118157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 14:44:17.343892 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.virt.hardware [None req-fa3e635f-7157-4dbb-94a4-ac30f88164bd tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Image pref 0:0:0 {{(pid=118157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 14:44:17.344305 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.virt.hardware [None req-fa3e635f-7157-4dbb-94a4-ac30f88164bd tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 14:44:17.353589 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-fa3e635f-7157-4dbb-94a4-ac30f88164bd tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:17.354052 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-fa3e635f-7157-4dbb-94a4-ac30f88164bd tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:17.354867 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-fa3e635f-7157-4dbb-94a4-ac30f88164bd tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:17.355312 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-fa3e635f-7157-4dbb-94a4-ac30f88164bd tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:17.373214 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.quota [None req-fa3e635f-7157-4dbb-94a4-ac30f88164bd tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Getting quotas for project 634574e706ee4f31bf4446871f11d5e0. Resources: {'instances', 'cores', 'ram'} {{(pid=118157) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 14:44:17.377401 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.quota [None req-fa3e635f-7157-4dbb-94a4-ac30f88164bd tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Getting quotas for user a605008cb5474f168f572fd0a9e71193 and project 634574e706ee4f31bf4446871f11d5e0. Resources: {'instances', 'cores', 'ram'} {{(pid=118157) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 14:44:17.397288 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-fa3e635f-7157-4dbb-94a4-ac30f88164bd tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Going to run 1 instances... {{(pid=118157) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 14:44:17.399625 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-fa3e635f-7157-4dbb-94a4-ac30f88164bd tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] [instance: a185db4f-620b-4359-a1ad-7f4efba9c869] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7802ce25-d370-43a3-8d85-0257d644d539',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118157) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 14:44:17.534449 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-ce9b4ded-9ad7-44f1-b6d9-e51e06f21988 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:44:17.535068 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-ce9b4ded-9ad7-44f1-b6d9-e51e06f21988 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:44:17.543006 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-ce9b4ded-9ad7-44f1-b6d9-e51e06f21988 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:17.543640 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-ce9b4ded-9ad7-44f1-b6d9-e51e06f21988 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:17.544718 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-ce9b4ded-9ad7-44f1-b6d9-e51e06f21988 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:17.545324 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-ce9b4ded-9ad7-44f1-b6d9-e51e06f21988 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:17.572185 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-fa3e635f-7157-4dbb-94a4-ac30f88164bd tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.967329 Jun 07 14:44:17.579537 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 230/469] 10.222.0.85 () {60 vars in 1146 bytes} [Tue Jun 7 14:44:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 975 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 14:44:17.591878 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-4c264c0e-d058-4a91-bfd5-ac1baacb5a62 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:44:17.591878 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-4c264c0e-d058-4a91-bfd5-ac1baacb5a62 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] [instance: a185db4f-620b-4359-a1ad-7f4efba9c869] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:44:17.682310 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-4c264c0e-d058-4a91-bfd5-ac1baacb5a62 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a605008cb5474f168f572fd0a9e71193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634574e706ee4f31bf4446871f11d5e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:17.692590 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-4c264c0e-d058-4a91-bfd5-ac1baacb5a62 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] 10.222.0.85 "GET /compute/v2.1/servers/a185db4f-620b-4359-a1ad-7f4efba9c869" status: 200 len: 1219 microversion: 2.1 time: 0.111869 Jun 07 14:44:17.693635 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 231/470] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:44:17 2022] GET /compute/v2.1/servers/a185db4f-620b-4359-a1ad-7f4efba9c869 => generated 1219 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:44:17.864026 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-ce9b4ded-9ad7-44f1-b6d9-e51e06f21988 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:17.872537 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-ce9b4ded-9ad7-44f1-b6d9-e51e06f21988 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:17.874543 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-ce9b4ded-9ad7-44f1-b6d9-e51e06f21988 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:17.876043 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-ce9b4ded-9ad7-44f1-b6d9-e51e06f21988 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1740 microversion: 2.20 time: 0.346168 Jun 07 14:44:17.888591 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 240/471] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:44:17 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1740 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:44:18.712313 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-8d6d0a14-0a6d-4549-b747-e3db5e76ece4 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:44:18.712988 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-8d6d0a14-0a6d-4549-b747-e3db5e76ece4 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] [instance: a185db4f-620b-4359-a1ad-7f4efba9c869] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:44:18.774595 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-8d6d0a14-0a6d-4549-b747-e3db5e76ece4 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a605008cb5474f168f572fd0a9e71193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634574e706ee4f31bf4446871f11d5e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:18.782796 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-8d6d0a14-0a6d-4549-b747-e3db5e76ece4 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] 10.222.0.85 "GET /compute/v2.1/servers/a185db4f-620b-4359-a1ad-7f4efba9c869" status: 200 len: 1219 microversion: 2.1 time: 0.074717 Jun 07 14:44:18.792890 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 232/472] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:44:18 2022] GET /compute/v2.1/servers/a185db4f-620b-4359-a1ad-7f4efba9c869 => generated 1219 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:44:18.896682 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-fabe6e80-3864-4a1b-a3c6-17b3d8f7d2d9 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:44:18.897399 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-fabe6e80-3864-4a1b-a3c6-17b3d8f7d2d9 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:44:18.904954 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-fabe6e80-3864-4a1b-a3c6-17b3d8f7d2d9 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:18.905811 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-fabe6e80-3864-4a1b-a3c6-17b3d8f7d2d9 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:18.906792 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-fabe6e80-3864-4a1b-a3c6-17b3d8f7d2d9 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:18.907229 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-fabe6e80-3864-4a1b-a3c6-17b3d8f7d2d9 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:19.067473 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-fabe6e80-3864-4a1b-a3c6-17b3d8f7d2d9 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:19.078007 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-fabe6e80-3864-4a1b-a3c6-17b3d8f7d2d9 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:19.080528 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-fabe6e80-3864-4a1b-a3c6-17b3d8f7d2d9 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:19.082637 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-fabe6e80-3864-4a1b-a3c6-17b3d8f7d2d9 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1740 microversion: 2.20 time: 0.190400 Jun 07 14:44:19.083962 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 241/473] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:44:18 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1740 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:44:19.803578 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-3f8c989b-1c9a-4af9-aa34-f8c358c5ec19 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:44:19.805323 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-3f8c989b-1c9a-4af9-aa34-f8c358c5ec19 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] [instance: a185db4f-620b-4359-a1ad-7f4efba9c869] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:44:19.814065 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-3f8c989b-1c9a-4af9-aa34-f8c358c5ec19 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:19.814526 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-3f8c989b-1c9a-4af9-aa34-f8c358c5ec19 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:19.815327 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-3f8c989b-1c9a-4af9-aa34-f8c358c5ec19 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:19.815759 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-3f8c989b-1c9a-4af9-aa34-f8c358c5ec19 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:19.886563 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-3f8c989b-1c9a-4af9-aa34-f8c358c5ec19 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a605008cb5474f168f572fd0a9e71193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634574e706ee4f31bf4446871f11d5e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:19.894628 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-3f8c989b-1c9a-4af9-aa34-f8c358c5ec19 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] 10.222.0.85 "GET /compute/v2.1/servers/a185db4f-620b-4359-a1ad-7f4efba9c869" status: 200 len: 1271 microversion: 2.1 time: 0.095793 Jun 07 14:44:19.895490 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 233/474] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:44:19 2022] GET /compute/v2.1/servers/a185db4f-620b-4359-a1ad-7f4efba9c869 => generated 1271 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:44:20.107115 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-882e8b43-3823-446b-b154-e8631f2d2dd7 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:44:20.107727 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-882e8b43-3823-446b-b154-e8631f2d2dd7 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:44:20.128087 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-882e8b43-3823-446b-b154-e8631f2d2dd7 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:20.128580 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-882e8b43-3823-446b-b154-e8631f2d2dd7 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:20.129427 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-882e8b43-3823-446b-b154-e8631f2d2dd7 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:20.129917 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-882e8b43-3823-446b-b154-e8631f2d2dd7 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:20.202562 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-9787e0c3-c2dd-4950-b4bc-6e222a69ccd8 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a64e513d-aa73-4193-b8d4-e946bc9063ac"}} {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:44:20.203902 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-9787e0c3-c2dd-4950-b4bc-6e222a69ccd8 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 7dec201c-634b-4b93-bc30-0ac8e60795c7] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:44:20.212084 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-9787e0c3-c2dd-4950-b4bc-6e222a69ccd8 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:20.215455 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-9787e0c3-c2dd-4950-b4bc-6e222a69ccd8 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:20.215455 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-9787e0c3-c2dd-4950-b4bc-6e222a69ccd8 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:20.215455 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-9787e0c3-c2dd-4950-b4bc-6e222a69ccd8 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:20.371216 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-882e8b43-3823-446b-b154-e8631f2d2dd7 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:20.384041 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-882e8b43-3823-446b-b154-e8631f2d2dd7 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:20.388781 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-882e8b43-3823-446b-b154-e8631f2d2dd7 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:20.388781 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-882e8b43-3823-446b-b154-e8631f2d2dd7 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1740 microversion: 2.20 time: 0.285083 Jun 07 14:44:20.389398 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 242/475] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:44:20 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1740 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:44:20.914583 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-44f21c4f-9f05-4fc6-ba9d-7d619b984b33 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:44:20.916623 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-44f21c4f-9f05-4fc6-ba9d-7d619b984b33 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] [instance: a185db4f-620b-4359-a1ad-7f4efba9c869] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:44:20.923216 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-44f21c4f-9f05-4fc6-ba9d-7d619b984b33 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:20.924392 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-44f21c4f-9f05-4fc6-ba9d-7d619b984b33 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:20.931892 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-44f21c4f-9f05-4fc6-ba9d-7d619b984b33 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:20.934055 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-44f21c4f-9f05-4fc6-ba9d-7d619b984b33 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:21.081795 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-44f21c4f-9f05-4fc6-ba9d-7d619b984b33 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a605008cb5474f168f572fd0a9e71193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634574e706ee4f31bf4446871f11d5e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:21.093035 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-44f21c4f-9f05-4fc6-ba9d-7d619b984b33 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] 10.222.0.85 "GET /compute/v2.1/servers/a185db4f-620b-4359-a1ad-7f4efba9c869" status: 200 len: 1277 microversion: 2.1 time: 0.183685 Jun 07 14:44:21.093709 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 243/476] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:44:20 2022] GET /compute/v2.1/servers/a185db4f-620b-4359-a1ad-7f4efba9c869 => generated 1277 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:44:21.407174 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-b7f2c475-103a-4179-9625-0077672dbb80 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:44:21.407889 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-b7f2c475-103a-4179-9625-0077672dbb80 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:44:21.415059 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-b7f2c475-103a-4179-9625-0077672dbb80 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:21.415449 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-b7f2c475-103a-4179-9625-0077672dbb80 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:21.416237 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-b7f2c475-103a-4179-9625-0077672dbb80 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:21.416705 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-b7f2c475-103a-4179-9625-0077672dbb80 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:21.553341 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-b7f2c475-103a-4179-9625-0077672dbb80 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:21.561272 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-b7f2c475-103a-4179-9625-0077672dbb80 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:21.562770 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-b7f2c475-103a-4179-9625-0077672dbb80 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:21.563917 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-b7f2c475-103a-4179-9625-0077672dbb80 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1740 microversion: 2.20 time: 0.160767 Jun 07 14:44:21.564496 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 244/477] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:44:21 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1740 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 14:44:21.921685 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-9787e0c3-c2dd-4950-b4bc-6e222a69ccd8 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "POST /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.725064 Jun 07 14:44:21.928229 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 234/478] 10.222.0.85 () {60 vars in 1322 bytes} [Tue Jun 7 14:44:20 2022] POST /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7/os-volume_attachments => generated 194 bytes in 1733 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:44:22.110680 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-c10e989b-233a-4c69-b946-26f4b5d39eb1 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:44:22.111302 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-c10e989b-233a-4c69-b946-26f4b5d39eb1 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] [instance: a185db4f-620b-4359-a1ad-7f4efba9c869] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:44:22.119333 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-c10e989b-233a-4c69-b946-26f4b5d39eb1 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:22.120041 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-c10e989b-233a-4c69-b946-26f4b5d39eb1 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:22.120591 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-c10e989b-233a-4c69-b946-26f4b5d39eb1 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:22.121030 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-c10e989b-233a-4c69-b946-26f4b5d39eb1 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:22.584354 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-ea5d55f7-e251-4faa-9cca-2062e7e221d8 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:44:22.585088 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-ea5d55f7-e251-4faa-9cca-2062e7e221d8 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:44:22.591482 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-ea5d55f7-e251-4faa-9cca-2062e7e221d8 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:22.591992 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-ea5d55f7-e251-4faa-9cca-2062e7e221d8 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:22.592874 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-ea5d55f7-e251-4faa-9cca-2062e7e221d8 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:22.593312 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-ea5d55f7-e251-4faa-9cca-2062e7e221d8 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:22.654919 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-c10e989b-233a-4c69-b946-26f4b5d39eb1 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a605008cb5474f168f572fd0a9e71193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634574e706ee4f31bf4446871f11d5e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:22.664190 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-c10e989b-233a-4c69-b946-26f4b5d39eb1 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] 10.222.0.85 "GET /compute/v2.1/servers/a185db4f-620b-4359-a1ad-7f4efba9c869" status: 200 len: 1319 microversion: 2.1 time: 0.557226 Jun 07 14:44:22.664795 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 245/479] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:44:22 2022] GET /compute/v2.1/servers/a185db4f-620b-4359-a1ad-7f4efba9c869 => generated 1319 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:44:22.751811 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-ea5d55f7-e251-4faa-9cca-2062e7e221d8 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:22.759850 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-ea5d55f7-e251-4faa-9cca-2062e7e221d8 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:22.764520 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-ea5d55f7-e251-4faa-9cca-2062e7e221d8 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:22.764520 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-ea5d55f7-e251-4faa-9cca-2062e7e221d8 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1740 microversion: 2.20 time: 0.183069 Jun 07 14:44:22.764520 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 235/480] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:44:22 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1740 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 14:44:23.212347 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [req-64843d61-3d1e-4be8-a96c-0b0ec6e2b53a req-de6ee938-89e1-43cb-9a34-46d12c597735 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a185db4f-620b-4359-a1ad-7f4efba9c869", "tag": "cd5fc492-abf3-4504-9ea2-0950cf9629cc"}]} {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:44:23.220763 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [req-64843d61-3d1e-4be8-a96c-0b0ec6e2b53a req-de6ee938-89e1-43cb-9a34-46d12c597735 service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:23.221290 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [req-64843d61-3d1e-4be8-a96c-0b0ec6e2b53a req-de6ee938-89e1-43cb-9a34-46d12c597735 service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:23.238034 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.compute.server_external_events [req-64843d61-3d1e-4be8-a96c-0b0ec6e2b53a req-de6ee938-89e1-43cb-9a34-46d12c597735 service nova] Creating event network-changed:cd5fc492-abf3-4504-9ea2-0950cf9629cc for instance a185db4f-620b-4359-a1ad-7f4efba9c869 on hv-cinder-84497 Jun 07 14:44:23.238507 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [req-64843d61-3d1e-4be8-a96c-0b0ec6e2b53a req-de6ee938-89e1-43cb-9a34-46d12c597735 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029867 Jun 07 14:44:23.239104 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 246/481] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jun 7 14:44:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:44:23.681902 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-2719b4a3-0370-46f3-873a-c7ce03ad8550 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:44:23.682518 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-2719b4a3-0370-46f3-873a-c7ce03ad8550 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] [instance: a185db4f-620b-4359-a1ad-7f4efba9c869] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:44:23.689101 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-2719b4a3-0370-46f3-873a-c7ce03ad8550 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:23.689549 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-2719b4a3-0370-46f3-873a-c7ce03ad8550 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:23.690675 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-2719b4a3-0370-46f3-873a-c7ce03ad8550 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:23.690831 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-2719b4a3-0370-46f3-873a-c7ce03ad8550 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:23.782077 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-41ae20d6-f421-44dc-aaef-7117e9e8eb65 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:44:23.782761 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-41ae20d6-f421-44dc-aaef-7117e9e8eb65 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:44:23.789126 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-41ae20d6-f421-44dc-aaef-7117e9e8eb65 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:23.789597 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-41ae20d6-f421-44dc-aaef-7117e9e8eb65 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:23.790359 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-41ae20d6-f421-44dc-aaef-7117e9e8eb65 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:23.790788 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-41ae20d6-f421-44dc-aaef-7117e9e8eb65 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:23.828821 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-2719b4a3-0370-46f3-873a-c7ce03ad8550 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a605008cb5474f168f572fd0a9e71193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634574e706ee4f31bf4446871f11d5e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:23.836597 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-2719b4a3-0370-46f3-873a-c7ce03ad8550 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] 10.222.0.85 "GET /compute/v2.1/servers/a185db4f-620b-4359-a1ad-7f4efba9c869" status: 200 len: 1319 microversion: 2.1 time: 0.158676 Jun 07 14:44:23.837271 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 236/482] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:44:23 2022] GET /compute/v2.1/servers/a185db4f-620b-4359-a1ad-7f4efba9c869 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:44:23.969449 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-41ae20d6-f421-44dc-aaef-7117e9e8eb65 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:23.977413 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-41ae20d6-f421-44dc-aaef-7117e9e8eb65 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:23.978953 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-41ae20d6-f421-44dc-aaef-7117e9e8eb65 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:23.980212 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-41ae20d6-f421-44dc-aaef-7117e9e8eb65 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1740 microversion: 2.20 time: 0.202771 Jun 07 14:44:23.980792 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 247/483] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:44:23 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1740 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 14:44:24.853662 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-fe85c13b-4d7a-48ce-b9d9-3b2f6353f66b tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:44:24.854202 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-fe85c13b-4d7a-48ce-b9d9-3b2f6353f66b tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] [instance: a185db4f-620b-4359-a1ad-7f4efba9c869] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:44:24.860752 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-fe85c13b-4d7a-48ce-b9d9-3b2f6353f66b tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:24.869442 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-fe85c13b-4d7a-48ce-b9d9-3b2f6353f66b tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:24.869442 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-fe85c13b-4d7a-48ce-b9d9-3b2f6353f66b tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:24.869442 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-fe85c13b-4d7a-48ce-b9d9-3b2f6353f66b tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:24.989626 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-fe85c13b-4d7a-48ce-b9d9-3b2f6353f66b tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a605008cb5474f168f572fd0a9e71193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634574e706ee4f31bf4446871f11d5e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:24.997282 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-fe85c13b-4d7a-48ce-b9d9-3b2f6353f66b tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] 10.222.0.85 "GET /compute/v2.1/servers/a185db4f-620b-4359-a1ad-7f4efba9c869" status: 200 len: 1319 microversion: 2.1 time: 0.147542 Jun 07 14:44:24.997838 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 237/484] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:44:24 2022] GET /compute/v2.1/servers/a185db4f-620b-4359-a1ad-7f4efba9c869 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:44:24.998833 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-fe5732c1-449f-42e9-913b-5db812d9f139 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:44:24.999439 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-fe5732c1-449f-42e9-913b-5db812d9f139 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:44:25.007133 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-fe5732c1-449f-42e9-913b-5db812d9f139 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:25.008219 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-fe5732c1-449f-42e9-913b-5db812d9f139 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:25.009006 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-fe5732c1-449f-42e9-913b-5db812d9f139 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:25.009439 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-fe5732c1-449f-42e9-913b-5db812d9f139 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:25.139202 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-fe5732c1-449f-42e9-913b-5db812d9f139 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:25.148873 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-fe5732c1-449f-42e9-913b-5db812d9f139 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:25.150372 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-fe5732c1-449f-42e9-913b-5db812d9f139 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:25.151543 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-fe5732c1-449f-42e9-913b-5db812d9f139 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1722 microversion: 2.20 time: 0.156514 Jun 07 14:44:25.152087 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 248/485] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:44:24 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 14:44:26.014474 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-ac6a9166-2a0c-4f61-bf21-7096cf5b0760 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:44:26.015080 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-ac6a9166-2a0c-4f61-bf21-7096cf5b0760 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] [instance: a185db4f-620b-4359-a1ad-7f4efba9c869] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:44:26.022875 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-ac6a9166-2a0c-4f61-bf21-7096cf5b0760 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:26.023324 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-ac6a9166-2a0c-4f61-bf21-7096cf5b0760 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:26.024109 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-ac6a9166-2a0c-4f61-bf21-7096cf5b0760 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:26.024582 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-ac6a9166-2a0c-4f61-bf21-7096cf5b0760 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:26.162621 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-ac6a9166-2a0c-4f61-bf21-7096cf5b0760 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a605008cb5474f168f572fd0a9e71193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634574e706ee4f31bf4446871f11d5e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:26.169808 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-7346206e-c4ce-46bf-b36e-842d045704f3 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:44:26.170452 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-7346206e-c4ce-46bf-b36e-842d045704f3 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:44:26.172752 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-ac6a9166-2a0c-4f61-bf21-7096cf5b0760 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] 10.222.0.85 "GET /compute/v2.1/servers/a185db4f-620b-4359-a1ad-7f4efba9c869" status: 200 len: 1319 microversion: 2.1 time: 0.161667 Jun 07 14:44:26.174083 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 238/486] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:44:26 2022] GET /compute/v2.1/servers/a185db4f-620b-4359-a1ad-7f4efba9c869 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:44:26.176964 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-7346206e-c4ce-46bf-b36e-842d045704f3 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:26.177413 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-7346206e-c4ce-46bf-b36e-842d045704f3 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:26.178193 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-7346206e-c4ce-46bf-b36e-842d045704f3 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:26.178783 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-7346206e-c4ce-46bf-b36e-842d045704f3 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:26.183233 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG dbcounter [-] [118158] Writing DB stats nova_cell1:SELECT=100 {{(pid=118158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:44:26.318606 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-7346206e-c4ce-46bf-b36e-842d045704f3 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:26.326870 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-7346206e-c4ce-46bf-b36e-842d045704f3 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:26.328404 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-7346206e-c4ce-46bf-b36e-842d045704f3 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:26.329582 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-7346206e-c4ce-46bf-b36e-842d045704f3 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1722 microversion: 2.20 time: 0.163610 Jun 07 14:44:26.330140 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 249/487] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:44:26 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:44:27.190039 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-7cc5a715-9344-4a3a-b02b-3046e4420e6b tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:44:27.190647 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-7cc5a715-9344-4a3a-b02b-3046e4420e6b tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] [instance: a185db4f-620b-4359-a1ad-7f4efba9c869] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:44:27.197269 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-7cc5a715-9344-4a3a-b02b-3046e4420e6b tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:27.197710 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-7cc5a715-9344-4a3a-b02b-3046e4420e6b tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:27.198463 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-7cc5a715-9344-4a3a-b02b-3046e4420e6b tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:27.198893 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-7cc5a715-9344-4a3a-b02b-3046e4420e6b tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:27.338968 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-7cc5a715-9344-4a3a-b02b-3046e4420e6b tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a605008cb5474f168f572fd0a9e71193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634574e706ee4f31bf4446871f11d5e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:27.342555 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG dbcounter [-] [118157] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:44:27.346969 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-7cc5a715-9344-4a3a-b02b-3046e4420e6b tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] 10.222.0.85 "GET /compute/v2.1/servers/a185db4f-620b-4359-a1ad-7f4efba9c869" status: 200 len: 1319 microversion: 2.1 time: 0.160712 Jun 07 14:44:27.347530 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 239/488] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:44:27 2022] GET /compute/v2.1/servers/a185db4f-620b-4359-a1ad-7f4efba9c869 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:44:27.350108 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-f36f775e-2089-451f-8c3b-dc73527b8659 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:44:27.350792 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-f36f775e-2089-451f-8c3b-dc73527b8659 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:44:27.359331 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-f36f775e-2089-451f-8c3b-dc73527b8659 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:27.359789 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-f36f775e-2089-451f-8c3b-dc73527b8659 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:27.360614 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-f36f775e-2089-451f-8c3b-dc73527b8659 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:27.361122 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-f36f775e-2089-451f-8c3b-dc73527b8659 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:27.507028 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-f36f775e-2089-451f-8c3b-dc73527b8659 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:27.518031 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-f36f775e-2089-451f-8c3b-dc73527b8659 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:27.520453 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-f36f775e-2089-451f-8c3b-dc73527b8659 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:27.521631 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-f36f775e-2089-451f-8c3b-dc73527b8659 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1722 microversion: 2.20 time: 0.176089 Jun 07 14:44:27.522343 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 250/489] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:44:27 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 14:44:28.364274 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-21f04e75-9b3f-44a1-911e-426a64236596 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:44:28.365054 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-21f04e75-9b3f-44a1-911e-426a64236596 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] [instance: a185db4f-620b-4359-a1ad-7f4efba9c869] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:44:28.367349 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG dbcounter [-] [118157] Writing DB stats nova_cell0:SELECT=2 {{(pid=118157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:44:28.368605 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG dbcounter [-] [118157] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=118157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:44:28.374107 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-21f04e75-9b3f-44a1-911e-426a64236596 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:28.374568 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-21f04e75-9b3f-44a1-911e-426a64236596 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:28.375452 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-21f04e75-9b3f-44a1-911e-426a64236596 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:28.375887 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-21f04e75-9b3f-44a1-911e-426a64236596 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:28.436684 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [req-001185eb-883b-4d47-81d0-bab01d455800 req-ff6f06ff-892a-4a2c-acf3-2beeba57bc7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8a8352c-4f05-4640-a976-edb025819089", "name": "network-vif-unplugged", "status": "completed", "tag": "557a43fa-c7ca-47d0-9a4b-fe35626e8941"}]} {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:44:28.447263 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [req-001185eb-883b-4d47-81d0-bab01d455800 req-ff6f06ff-892a-4a2c-acf3-2beeba57bc7e service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:28.447859 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [req-001185eb-883b-4d47-81d0-bab01d455800 req-ff6f06ff-892a-4a2c-acf3-2beeba57bc7e service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:28.461451 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.compute.server_external_events [req-001185eb-883b-4d47-81d0-bab01d455800 req-ff6f06ff-892a-4a2c-acf3-2beeba57bc7e service nova] Creating event network-vif-unplugged:557a43fa-c7ca-47d0-9a4b-fe35626e8941 for instance a8a8352c-4f05-4640-a976-edb025819089 on hv-cinder-84497 Jun 07 14:44:28.467093 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [req-001185eb-883b-4d47-81d0-bab01d455800 req-ff6f06ff-892a-4a2c-acf3-2beeba57bc7e service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034324 Jun 07 14:44:28.467702 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 251/490] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jun 7 14:44:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 14:44:28.519639 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-21f04e75-9b3f-44a1-911e-426a64236596 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a605008cb5474f168f572fd0a9e71193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634574e706ee4f31bf4446871f11d5e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:28.527958 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-21f04e75-9b3f-44a1-911e-426a64236596 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] 10.222.0.85 "GET /compute/v2.1/servers/a185db4f-620b-4359-a1ad-7f4efba9c869" status: 200 len: 1319 microversion: 2.1 time: 0.167617 Jun 07 14:44:28.528586 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 240/491] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:44:28 2022] GET /compute/v2.1/servers/a185db4f-620b-4359-a1ad-7f4efba9c869 => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:44:28.542481 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-661b21c8-1d4c-4b99-8a1e-99cbaad9bbf9 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:44:28.543195 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-661b21c8-1d4c-4b99-8a1e-99cbaad9bbf9 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:44:28.550053 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-661b21c8-1d4c-4b99-8a1e-99cbaad9bbf9 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:28.551032 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-661b21c8-1d4c-4b99-8a1e-99cbaad9bbf9 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:28.554819 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-661b21c8-1d4c-4b99-8a1e-99cbaad9bbf9 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:28.554819 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-661b21c8-1d4c-4b99-8a1e-99cbaad9bbf9 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:28.687868 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-661b21c8-1d4c-4b99-8a1e-99cbaad9bbf9 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:28.696693 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-661b21c8-1d4c-4b99-8a1e-99cbaad9bbf9 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:28.698224 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-661b21c8-1d4c-4b99-8a1e-99cbaad9bbf9 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:28.699371 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-661b21c8-1d4c-4b99-8a1e-99cbaad9bbf9 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1722 microversion: 2.20 time: 0.161657 Jun 07 14:44:28.699922 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 252/492] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:44:28 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:44:29.545126 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-2f03fdb8-40c8-4d6d-ac47-dcfa7000895d tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:44:29.545734 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-2f03fdb8-40c8-4d6d-ac47-dcfa7000895d tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] [instance: a185db4f-620b-4359-a1ad-7f4efba9c869] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:44:29.547863 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG dbcounter [-] [118157] Writing DB stats nova_cell0:SELECT=10 {{(pid=118157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:44:29.554760 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-2f03fdb8-40c8-4d6d-ac47-dcfa7000895d tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:29.555207 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-2f03fdb8-40c8-4d6d-ac47-dcfa7000895d tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:29.555970 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-2f03fdb8-40c8-4d6d-ac47-dcfa7000895d tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:29.556425 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-2f03fdb8-40c8-4d6d-ac47-dcfa7000895d tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:29.686530 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-2f03fdb8-40c8-4d6d-ac47-dcfa7000895d tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a605008cb5474f168f572fd0a9e71193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634574e706ee4f31bf4446871f11d5e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:29.694077 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-2f03fdb8-40c8-4d6d-ac47-dcfa7000895d tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] 10.222.0.85 "GET /compute/v2.1/servers/a185db4f-620b-4359-a1ad-7f4efba9c869" status: 200 len: 1319 microversion: 2.1 time: 0.153435 Jun 07 14:44:29.694628 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 241/493] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:44:29 2022] GET /compute/v2.1/servers/a185db4f-620b-4359-a1ad-7f4efba9c869 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:44:29.732311 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-fc5806a5-0699-4c49-952a-34fb8d04b47b tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:44:29.732311 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-fc5806a5-0699-4c49-952a-34fb8d04b47b tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:44:29.732311 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-fc5806a5-0699-4c49-952a-34fb8d04b47b tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:29.732311 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-fc5806a5-0699-4c49-952a-34fb8d04b47b tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:29.733131 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-fc5806a5-0699-4c49-952a-34fb8d04b47b tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:29.733131 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-fc5806a5-0699-4c49-952a-34fb8d04b47b tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:29.865110 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-fc5806a5-0699-4c49-952a-34fb8d04b47b tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:29.872948 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-fc5806a5-0699-4c49-952a-34fb8d04b47b tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:29.874436 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-fc5806a5-0699-4c49-952a-34fb8d04b47b tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:29.875579 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-fc5806a5-0699-4c49-952a-34fb8d04b47b tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1722 microversion: 2.20 time: 0.161326 Jun 07 14:44:29.876129 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 253/494] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:44:29 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:44:30.710605 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-7f60f010-b5f7-4d6a-9c1b-916eb5717dae tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:44:30.711404 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-7f60f010-b5f7-4d6a-9c1b-916eb5717dae tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] [instance: a185db4f-620b-4359-a1ad-7f4efba9c869] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:44:30.718844 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-7f60f010-b5f7-4d6a-9c1b-916eb5717dae tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:30.719294 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-7f60f010-b5f7-4d6a-9c1b-916eb5717dae tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:30.720064 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-7f60f010-b5f7-4d6a-9c1b-916eb5717dae tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:30.720556 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-7f60f010-b5f7-4d6a-9c1b-916eb5717dae tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:30.854206 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-7f60f010-b5f7-4d6a-9c1b-916eb5717dae tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a605008cb5474f168f572fd0a9e71193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634574e706ee4f31bf4446871f11d5e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:30.861771 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-7f60f010-b5f7-4d6a-9c1b-916eb5717dae tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] 10.222.0.85 "GET /compute/v2.1/servers/a185db4f-620b-4359-a1ad-7f4efba9c869" status: 200 len: 1319 microversion: 2.1 time: 0.155153 Jun 07 14:44:30.862321 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 242/495] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:44:30 2022] GET /compute/v2.1/servers/a185db4f-620b-4359-a1ad-7f4efba9c869 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:44:30.894568 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-14b62abe-79d7-436b-a8cf-2de134929198 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:44:30.895848 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-14b62abe-79d7-436b-a8cf-2de134929198 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:44:30.902780 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-14b62abe-79d7-436b-a8cf-2de134929198 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:30.903235 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-14b62abe-79d7-436b-a8cf-2de134929198 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:30.904016 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-14b62abe-79d7-436b-a8cf-2de134929198 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:30.904484 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-14b62abe-79d7-436b-a8cf-2de134929198 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:30.978153 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [req-42fd446d-ea34-4f5d-9b31-c95fd971f207 req-bcd75cca-bdde-4350-89c1-1e98c35f1383 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a185db4f-620b-4359-a1ad-7f4efba9c869", "name": "network-vif-plugged", "status": "completed", "tag": "cd5fc492-abf3-4504-9ea2-0950cf9629cc"}]} {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:44:31.004162 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [req-42fd446d-ea34-4f5d-9b31-c95fd971f207 req-bcd75cca-bdde-4350-89c1-1e98c35f1383 service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:31.004162 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [req-42fd446d-ea34-4f5d-9b31-c95fd971f207 req-bcd75cca-bdde-4350-89c1-1e98c35f1383 service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:31.004162 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.compute.server_external_events [req-42fd446d-ea34-4f5d-9b31-c95fd971f207 req-bcd75cca-bdde-4350-89c1-1e98c35f1383 service nova] Creating event network-vif-plugged:cd5fc492-abf3-4504-9ea2-0950cf9629cc for instance a185db4f-620b-4359-a1ad-7f4efba9c869 on hv-cinder-84497 Jun 07 14:44:31.005093 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [req-42fd446d-ea34-4f5d-9b31-c95fd971f207 req-bcd75cca-bdde-4350-89c1-1e98c35f1383 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031735 Jun 07 14:44:31.005688 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 243/496] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jun 7 14:44:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 14:44:31.041479 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-14b62abe-79d7-436b-a8cf-2de134929198 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:31.049800 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-14b62abe-79d7-436b-a8cf-2de134929198 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:31.052066 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-14b62abe-79d7-436b-a8cf-2de134929198 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:31.053152 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-14b62abe-79d7-436b-a8cf-2de134929198 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1725 microversion: 2.20 time: 0.163054 Jun 07 14:44:31.053705 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 254/497] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:44:30 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:44:31.077276 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-46a4b81f-c26e-434d-a068-53f6935f5502 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cebcf912-00bf-4af0-a6cf-cc4893a5b893"}} {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:44:31.078685 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-46a4b81f-c26e-434d-a068-53f6935f5502 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:44:31.086882 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-46a4b81f-c26e-434d-a068-53f6935f5502 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:31.086882 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-46a4b81f-c26e-434d-a068-53f6935f5502 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:31.086882 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-46a4b81f-c26e-434d-a068-53f6935f5502 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:31.090260 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-46a4b81f-c26e-434d-a068-53f6935f5502 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:31.879116 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-539e0b45-b7fa-4a23-9a50-3b66e3d9d61e tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:44:31.888439 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-539e0b45-b7fa-4a23-9a50-3b66e3d9d61e tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] [instance: a185db4f-620b-4359-a1ad-7f4efba9c869] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:44:31.888439 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG dbcounter [-] [118158] Writing DB stats nova_api:SELECT=46 {{(pid=118158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:44:31.888439 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-539e0b45-b7fa-4a23-9a50-3b66e3d9d61e tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:31.888439 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-539e0b45-b7fa-4a23-9a50-3b66e3d9d61e tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:31.888835 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-539e0b45-b7fa-4a23-9a50-3b66e3d9d61e tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:31.889182 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-539e0b45-b7fa-4a23-9a50-3b66e3d9d61e tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:32.021506 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-539e0b45-b7fa-4a23-9a50-3b66e3d9d61e tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a605008cb5474f168f572fd0a9e71193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634574e706ee4f31bf4446871f11d5e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:32.028919 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-539e0b45-b7fa-4a23-9a50-3b66e3d9d61e tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] 10.222.0.85 "GET /compute/v2.1/servers/a185db4f-620b-4359-a1ad-7f4efba9c869" status: 200 len: 1319 microversion: 2.1 time: 0.153748 Jun 07 14:44:32.029487 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 255/498] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:44:31 2022] GET /compute/v2.1/servers/a185db4f-620b-4359-a1ad-7f4efba9c869 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:44:32.309022 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-46a4b81f-c26e-434d-a068-53f6935f5502 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "POST /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.236078 Jun 07 14:44:32.309716 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 244/499] 10.222.0.85 () {62 vars in 1363 bytes} [Tue Jun 7 14:44:31 2022] POST /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089/os-volume_attachments => generated 188 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 14:44:32.428416 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-a480c0e3-28b2-4621-aac6-fcff9775d7fb tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:44:32.428956 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-a480c0e3-28b2-4621-aac6-fcff9775d7fb tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:44:32.434915 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-a480c0e3-28b2-4621-aac6-fcff9775d7fb tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:32.435365 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-a480c0e3-28b2-4621-aac6-fcff9775d7fb tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:32.436122 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-a480c0e3-28b2-4621-aac6-fcff9775d7fb tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:32.436600 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-a480c0e3-28b2-4621-aac6-fcff9775d7fb tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:32.636923 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-a480c0e3-28b2-4621-aac6-fcff9775d7fb tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "POST /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089/action" status: 202 len: 0 microversion: 2.20 time: 0.212919 Jun 07 14:44:32.637828 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 256/500] 10.222.0.85 () {62 vars in 1318 bytes} [Tue Jun 7 14:44:32 2022] POST /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089/action => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 07 14:44:32.646574 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-7ff4b08f-8e54-4424-a22d-24a9a580eaa1 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:44:32.647393 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-7ff4b08f-8e54-4424-a22d-24a9a580eaa1 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:44:32.655533 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-7ff4b08f-8e54-4424-a22d-24a9a580eaa1 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:32.655533 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-7ff4b08f-8e54-4424-a22d-24a9a580eaa1 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:32.656580 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-7ff4b08f-8e54-4424-a22d-24a9a580eaa1 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:32.656580 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-7ff4b08f-8e54-4424-a22d-24a9a580eaa1 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:32.768046 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-10efcc68-027a-48b4-ab14-3c9e79bc1f16 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:44:32.769658 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-10efcc68-027a-48b4-ab14-3c9e79bc1f16 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 7dec201c-634b-4b93-bc30-0ac8e60795c7] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:44:32.777183 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-10efcc68-027a-48b4-ab14-3c9e79bc1f16 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:32.777947 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-10efcc68-027a-48b4-ab14-3c9e79bc1f16 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:32.778948 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-10efcc68-027a-48b4-ab14-3c9e79bc1f16 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:32.779522 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-10efcc68-027a-48b4-ab14-3c9e79bc1f16 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:32.808940 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-7ff4b08f-8e54-4424-a22d-24a9a580eaa1 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:32.810918 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.objects.instance [None req-10efcc68-027a-48b4-ab14-3c9e79bc1f16 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lazy-loading 'flavor' on Instance uuid 7dec201c-634b-4b93-bc30-0ac8e60795c7 {{(pid=118158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 14:44:32.818115 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-7ff4b08f-8e54-4424-a22d-24a9a580eaa1 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:32.819622 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-7ff4b08f-8e54-4424-a22d-24a9a580eaa1 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:32.820820 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-7ff4b08f-8e54-4424-a22d-24a9a580eaa1 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1751 microversion: 2.20 time: 0.179046 Jun 07 14:44:32.821625 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 245/501] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:44:32 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1751 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:44:33.046939 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-fac2e089-dcf0-4172-89aa-1a51de16dfb2 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:44:33.047492 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-fac2e089-dcf0-4172-89aa-1a51de16dfb2 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] [instance: a185db4f-620b-4359-a1ad-7f4efba9c869] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:44:33.053697 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-fac2e089-dcf0-4172-89aa-1a51de16dfb2 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:33.057685 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-fac2e089-dcf0-4172-89aa-1a51de16dfb2 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:33.057685 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-fac2e089-dcf0-4172-89aa-1a51de16dfb2 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:33.057685 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-fac2e089-dcf0-4172-89aa-1a51de16dfb2 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:33.134872 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-10efcc68-027a-48b4-ab14-3c9e79bc1f16 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "POST /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7/action" status: 200 len: 32 microversion: 2.1 time: 0.370736 Jun 07 14:44:33.135479 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 257/502] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Jun 7 14:44:32 2022] POST /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7/action => generated 32 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 07 14:44:33.152956 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-9f9c49cc-93f4-47eb-a9d0-24ad0c263da0 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:44:33.153960 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-9f9c49cc-93f4-47eb-a9d0-24ad0c263da0 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 7dec201c-634b-4b93-bc30-0ac8e60795c7] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:44:33.170852 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-9f9c49cc-93f4-47eb-a9d0-24ad0c263da0 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:33.171343 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-9f9c49cc-93f4-47eb-a9d0-24ad0c263da0 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:33.172118 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-9f9c49cc-93f4-47eb-a9d0-24ad0c263da0 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:33.172598 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-9f9c49cc-93f4-47eb-a9d0-24ad0c263da0 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:33.202853 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-fac2e089-dcf0-4172-89aa-1a51de16dfb2 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a605008cb5474f168f572fd0a9e71193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634574e706ee4f31bf4446871f11d5e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:33.211576 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-fac2e089-dcf0-4172-89aa-1a51de16dfb2 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] 10.222.0.85 "GET /compute/v2.1/servers/a185db4f-620b-4359-a1ad-7f4efba9c869" status: 200 len: 1319 microversion: 2.1 time: 0.169418 Jun 07 14:44:33.212141 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 246/503] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:44:33 2022] GET /compute/v2.1/servers/a185db4f-620b-4359-a1ad-7f4efba9c869 => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:44:33.349342 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-9f9c49cc-93f4-47eb-a9d0-24ad0c263da0 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:33.358784 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-9f9c49cc-93f4-47eb-a9d0-24ad0c263da0 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7" status: 200 len: 1734 microversion: 2.1 time: 0.217741 Jun 07 14:44:33.359627 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 258/504] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:44:33 2022] GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7 => generated 1734 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:44:33.839475 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-6bbfddf7-0509-4bec-a349-273b1a7c1ba6 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:44:33.840090 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-6bbfddf7-0509-4bec-a349-273b1a7c1ba6 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:44:33.846569 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-6bbfddf7-0509-4bec-a349-273b1a7c1ba6 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:33.847027 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-6bbfddf7-0509-4bec-a349-273b1a7c1ba6 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:33.847766 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-6bbfddf7-0509-4bec-a349-273b1a7c1ba6 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:33.848191 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-6bbfddf7-0509-4bec-a349-273b1a7c1ba6 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:33.986107 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-6bbfddf7-0509-4bec-a349-273b1a7c1ba6 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:34.000681 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-6bbfddf7-0509-4bec-a349-273b1a7c1ba6 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:34.003158 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-6bbfddf7-0509-4bec-a349-273b1a7c1ba6 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:34.003616 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-6bbfddf7-0509-4bec-a349-273b1a7c1ba6 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1751 microversion: 2.20 time: 0.168193 Jun 07 14:44:34.004166 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 247/505] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:44:33 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1751 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:44:34.230250 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-25c946da-ed93-458a-9d72-28279da980f4 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:44:34.230889 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-25c946da-ed93-458a-9d72-28279da980f4 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] [instance: a185db4f-620b-4359-a1ad-7f4efba9c869] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:44:34.237625 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-25c946da-ed93-458a-9d72-28279da980f4 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:34.238084 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-25c946da-ed93-458a-9d72-28279da980f4 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:34.238855 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-25c946da-ed93-458a-9d72-28279da980f4 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:34.239309 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-25c946da-ed93-458a-9d72-28279da980f4 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:34.376868 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-df869849-a5ac-44c9-92bd-d6930e4fe338 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:44:34.377492 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-df869849-a5ac-44c9-92bd-d6930e4fe338 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 7dec201c-634b-4b93-bc30-0ac8e60795c7] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:44:34.383822 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-df869849-a5ac-44c9-92bd-d6930e4fe338 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:34.384271 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-df869849-a5ac-44c9-92bd-d6930e4fe338 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:34.385091 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-df869849-a5ac-44c9-92bd-d6930e4fe338 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:34.385544 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-df869849-a5ac-44c9-92bd-d6930e4fe338 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:34.453433 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-25c946da-ed93-458a-9d72-28279da980f4 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a605008cb5474f168f572fd0a9e71193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634574e706ee4f31bf4446871f11d5e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:34.466561 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-25c946da-ed93-458a-9d72-28279da980f4 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] 10.222.0.85 "GET /compute/v2.1/servers/a185db4f-620b-4359-a1ad-7f4efba9c869" status: 200 len: 1507 microversion: 2.1 time: 0.240826 Jun 07 14:44:34.467132 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 259/506] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:44:34 2022] GET /compute/v2.1/servers/a185db4f-620b-4359-a1ad-7f4efba9c869 => generated 1507 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:44:34.485629 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-4e4d4595-2355-4b6e-ac8a-f3eb6e326cfe tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "13104e74-0abc-49f7-a1ef-a82e33b381e2", "device": "/dev/sdb"}} {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:44:34.486884 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-4e4d4595-2355-4b6e-ac8a-f3eb6e326cfe tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] [instance: a185db4f-620b-4359-a1ad-7f4efba9c869] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:44:34.496355 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-4e4d4595-2355-4b6e-ac8a-f3eb6e326cfe tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:34.496355 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-4e4d4595-2355-4b6e-ac8a-f3eb6e326cfe tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:34.496355 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-4e4d4595-2355-4b6e-ac8a-f3eb6e326cfe tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:34.496355 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-4e4d4595-2355-4b6e-ac8a-f3eb6e326cfe tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:34.523974 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-df869849-a5ac-44c9-92bd-d6930e4fe338 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:34.533378 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-df869849-a5ac-44c9-92bd-d6930e4fe338 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7" status: 200 len: 1734 microversion: 2.1 time: 0.160307 Jun 07 14:44:34.534108 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 248/507] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:44:34 2022] GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7 => generated 1734 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:44:35.022504 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-2df2a176-e4e7-461c-a7fa-d2071e0967a0 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:44:35.023160 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-2df2a176-e4e7-461c-a7fa-d2071e0967a0 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:44:35.032112 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-2df2a176-e4e7-461c-a7fa-d2071e0967a0 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:35.032112 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-2df2a176-e4e7-461c-a7fa-d2071e0967a0 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:35.032112 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-2df2a176-e4e7-461c-a7fa-d2071e0967a0 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:35.032112 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-2df2a176-e4e7-461c-a7fa-d2071e0967a0 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:35.166743 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-2df2a176-e4e7-461c-a7fa-d2071e0967a0 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:35.175537 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-2df2a176-e4e7-461c-a7fa-d2071e0967a0 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:35.177609 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-2df2a176-e4e7-461c-a7fa-d2071e0967a0 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:35.178835 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-2df2a176-e4e7-461c-a7fa-d2071e0967a0 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1753 microversion: 2.20 time: 0.160498 Jun 07 14:44:35.179429 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 249/508] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:44:35 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1753 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 14:44:35.350968 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-4e4d4595-2355-4b6e-ac8a-f3eb6e326cfe tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] 10.222.0.85 "POST /compute/v2.1/servers/a185db4f-620b-4359-a1ad-7f4efba9c869/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.869831 Jun 07 14:44:35.351800 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 260/509] 10.222.0.85 () {60 vars in 1322 bytes} [Tue Jun 7 14:44:34 2022] POST /compute/v2.1/servers/a185db4f-620b-4359-a1ad-7f4efba9c869/os-volume_attachments => generated 194 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 14:44:35.551138 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-2156d1bd-ee68-4ca8-b542-e370ff42022e tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:44:35.552509 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-2156d1bd-ee68-4ca8-b542-e370ff42022e tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 7dec201c-634b-4b93-bc30-0ac8e60795c7] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:44:35.558784 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-2156d1bd-ee68-4ca8-b542-e370ff42022e tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:35.559229 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-2156d1bd-ee68-4ca8-b542-e370ff42022e tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:35.559980 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-2156d1bd-ee68-4ca8-b542-e370ff42022e tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:35.560459 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-2156d1bd-ee68-4ca8-b542-e370ff42022e tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:35.688563 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-2156d1bd-ee68-4ca8-b542-e370ff42022e tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:35.696795 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-2156d1bd-ee68-4ca8-b542-e370ff42022e tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7" status: 200 len: 1734 microversion: 2.1 time: 0.149423 Jun 07 14:44:35.703246 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 250/510] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:44:35 2022] GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:44:36.199499 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-d5c7fcef-4543-41a6-b571-76f98e1e8aea tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:44:36.200088 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-d5c7fcef-4543-41a6-b571-76f98e1e8aea tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:44:36.206309 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-d5c7fcef-4543-41a6-b571-76f98e1e8aea tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:36.206769 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-d5c7fcef-4543-41a6-b571-76f98e1e8aea tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:36.207568 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-d5c7fcef-4543-41a6-b571-76f98e1e8aea tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:36.208041 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-d5c7fcef-4543-41a6-b571-76f98e1e8aea tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:36.349204 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-d5c7fcef-4543-41a6-b571-76f98e1e8aea tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:36.357844 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-d5c7fcef-4543-41a6-b571-76f98e1e8aea tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:36.359356 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-d5c7fcef-4543-41a6-b571-76f98e1e8aea tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:36.360555 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-d5c7fcef-4543-41a6-b571-76f98e1e8aea tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1809 microversion: 2.20 time: 0.165936 Jun 07 14:44:36.361106 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 261/511] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:44:36 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:44:36.713835 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-db769648-e354-4303-a6c4-f040f57d9660 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:44:36.714586 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-db769648-e354-4303-a6c4-f040f57d9660 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 7dec201c-634b-4b93-bc30-0ac8e60795c7] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:44:36.721392 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-db769648-e354-4303-a6c4-f040f57d9660 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:36.721847 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-db769648-e354-4303-a6c4-f040f57d9660 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:36.723237 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-db769648-e354-4303-a6c4-f040f57d9660 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:36.724152 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-db769648-e354-4303-a6c4-f040f57d9660 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:36.857201 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-db769648-e354-4303-a6c4-f040f57d9660 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:36.866153 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-db769648-e354-4303-a6c4-f040f57d9660 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7" status: 200 len: 1734 microversion: 2.1 time: 0.156146 Jun 07 14:44:36.866720 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 251/512] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:44:36 2022] GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:44:37.378903 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-00e3b44b-ee1e-44e4-8b39-14cd4e2cf743 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:44:37.379454 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-00e3b44b-ee1e-44e4-8b39-14cd4e2cf743 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:44:37.385970 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-00e3b44b-ee1e-44e4-8b39-14cd4e2cf743 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:37.386424 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-00e3b44b-ee1e-44e4-8b39-14cd4e2cf743 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:37.387189 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-00e3b44b-ee1e-44e4-8b39-14cd4e2cf743 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:37.387628 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-00e3b44b-ee1e-44e4-8b39-14cd4e2cf743 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:37.391716 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG dbcounter [-] [118158] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=118158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:44:37.537357 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-00e3b44b-ee1e-44e4-8b39-14cd4e2cf743 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:37.545698 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-00e3b44b-ee1e-44e4-8b39-14cd4e2cf743 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:37.547300 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-00e3b44b-ee1e-44e4-8b39-14cd4e2cf743 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:37.548466 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-00e3b44b-ee1e-44e4-8b39-14cd4e2cf743 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1809 microversion: 2.20 time: 0.173447 Jun 07 14:44:37.549012 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 262/513] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:44:37 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1809 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:44:37.888298 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-54c1ff18-ca02-481f-bcd6-e69eae4e44e1 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:44:37.890562 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-54c1ff18-ca02-481f-bcd6-e69eae4e44e1 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 7dec201c-634b-4b93-bc30-0ac8e60795c7] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:44:37.901297 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-54c1ff18-ca02-481f-bcd6-e69eae4e44e1 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:37.902025 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-54c1ff18-ca02-481f-bcd6-e69eae4e44e1 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:37.907628 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-54c1ff18-ca02-481f-bcd6-e69eae4e44e1 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:37.907628 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-54c1ff18-ca02-481f-bcd6-e69eae4e44e1 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:38.064874 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-54c1ff18-ca02-481f-bcd6-e69eae4e44e1 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:38.073470 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-54c1ff18-ca02-481f-bcd6-e69eae4e44e1 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7" status: 200 len: 1734 microversion: 2.1 time: 0.191913 Jun 07 14:44:38.074039 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 252/514] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:44:37 2022] GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7 => generated 1734 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:44:38.566666 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-cec3d6c3-b769-47c4-9d94-521df4808b00 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:44:38.567436 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-cec3d6c3-b769-47c4-9d94-521df4808b00 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:44:38.573922 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-cec3d6c3-b769-47c4-9d94-521df4808b00 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:38.574385 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-cec3d6c3-b769-47c4-9d94-521df4808b00 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:38.575175 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-cec3d6c3-b769-47c4-9d94-521df4808b00 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:38.575616 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-cec3d6c3-b769-47c4-9d94-521df4808b00 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:38.712132 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-cec3d6c3-b769-47c4-9d94-521df4808b00 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:38.721465 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-cec3d6c3-b769-47c4-9d94-521df4808b00 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:38.724386 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-cec3d6c3-b769-47c4-9d94-521df4808b00 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:38.726630 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-cec3d6c3-b769-47c4-9d94-521df4808b00 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1809 microversion: 2.20 time: 0.163244 Jun 07 14:44:38.728450 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 263/515] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:44:38 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:44:39.090459 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-43c82350-c987-41bd-80d3-3530f4fd5503 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:44:39.091053 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-43c82350-c987-41bd-80d3-3530f4fd5503 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 7dec201c-634b-4b93-bc30-0ac8e60795c7] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:44:39.097635 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-43c82350-c987-41bd-80d3-3530f4fd5503 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:39.098082 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-43c82350-c987-41bd-80d3-3530f4fd5503 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:39.098846 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-43c82350-c987-41bd-80d3-3530f4fd5503 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:39.099281 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-43c82350-c987-41bd-80d3-3530f4fd5503 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:39.238655 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-43c82350-c987-41bd-80d3-3530f4fd5503 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:39.248758 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-43c82350-c987-41bd-80d3-3530f4fd5503 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7" status: 200 len: 1734 microversion: 2.1 time: 0.162020 Jun 07 14:44:39.249339 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 253/516] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:44:39 2022] GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7 => generated 1734 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:44:39.748264 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-ac27e455-5a89-49f5-97f2-6865c21f188a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:44:39.749498 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-ac27e455-5a89-49f5-97f2-6865c21f188a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:44:39.757316 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-ac27e455-5a89-49f5-97f2-6865c21f188a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:39.758011 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-ac27e455-5a89-49f5-97f2-6865c21f188a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:39.759015 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-ac27e455-5a89-49f5-97f2-6865c21f188a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:39.759609 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-ac27e455-5a89-49f5-97f2-6865c21f188a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:39.896521 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-ac27e455-5a89-49f5-97f2-6865c21f188a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:39.905019 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-ac27e455-5a89-49f5-97f2-6865c21f188a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:39.906512 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-ac27e455-5a89-49f5-97f2-6865c21f188a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:39.907660 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-ac27e455-5a89-49f5-97f2-6865c21f188a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1809 microversion: 2.20 time: 0.164785 Jun 07 14:44:39.908204 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 264/517] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:44:39 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:44:40.266626 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-e799c54d-2cdd-4c5c-8cbf-d1e5830c6169 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:44:40.267242 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-e799c54d-2cdd-4c5c-8cbf-d1e5830c6169 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 7dec201c-634b-4b93-bc30-0ac8e60795c7] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:44:40.274246 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-e799c54d-2cdd-4c5c-8cbf-d1e5830c6169 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:40.274684 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-e799c54d-2cdd-4c5c-8cbf-d1e5830c6169 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:40.275454 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-e799c54d-2cdd-4c5c-8cbf-d1e5830c6169 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:40.275890 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-e799c54d-2cdd-4c5c-8cbf-d1e5830c6169 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:40.299453 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG dbcounter [-] [118157] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=118157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:44:40.415047 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-e799c54d-2cdd-4c5c-8cbf-d1e5830c6169 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:40.423643 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-e799c54d-2cdd-4c5c-8cbf-d1e5830c6169 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7" status: 200 len: 1734 microversion: 2.1 time: 0.160904 Jun 07 14:44:40.424570 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 254/518] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:44:40 2022] GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7 => generated 1734 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:44:40.927683 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-606939c8-8f36-4b4a-9282-7ee10d7d8c84 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:44:40.929227 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-606939c8-8f36-4b4a-9282-7ee10d7d8c84 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:44:40.940792 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-606939c8-8f36-4b4a-9282-7ee10d7d8c84 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:40.941277 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-606939c8-8f36-4b4a-9282-7ee10d7d8c84 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:40.942266 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-606939c8-8f36-4b4a-9282-7ee10d7d8c84 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:40.942731 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-606939c8-8f36-4b4a-9282-7ee10d7d8c84 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:41.074972 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-606939c8-8f36-4b4a-9282-7ee10d7d8c84 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:41.083832 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-606939c8-8f36-4b4a-9282-7ee10d7d8c84 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:41.085361 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-606939c8-8f36-4b4a-9282-7ee10d7d8c84 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:41.086511 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-606939c8-8f36-4b4a-9282-7ee10d7d8c84 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1809 microversion: 2.20 time: 0.163730 Jun 07 14:44:41.087067 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 265/519] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:44:40 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:44:41.441612 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-9f59123a-6491-4426-adba-7b3cb717a9b8 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:44:41.442722 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-9f59123a-6491-4426-adba-7b3cb717a9b8 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 7dec201c-634b-4b93-bc30-0ac8e60795c7] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:44:41.451908 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-9f59123a-6491-4426-adba-7b3cb717a9b8 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:41.452353 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-9f59123a-6491-4426-adba-7b3cb717a9b8 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:41.453148 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-9f59123a-6491-4426-adba-7b3cb717a9b8 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:41.453581 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-9f59123a-6491-4426-adba-7b3cb717a9b8 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:41.590486 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-9f59123a-6491-4426-adba-7b3cb717a9b8 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:41.598408 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-9f59123a-6491-4426-adba-7b3cb717a9b8 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7" status: 200 len: 1734 microversion: 2.1 time: 0.160758 Jun 07 14:44:41.598980 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 255/520] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:44:41 2022] GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7 => generated 1734 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:44:42.105410 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-e3a4ab3a-7acb-422a-b1b8-17bdb427ae2b tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:44:42.105966 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-e3a4ab3a-7acb-422a-b1b8-17bdb427ae2b tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:44:42.112601 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-e3a4ab3a-7acb-422a-b1b8-17bdb427ae2b tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:42.113057 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-e3a4ab3a-7acb-422a-b1b8-17bdb427ae2b tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:42.113825 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-e3a4ab3a-7acb-422a-b1b8-17bdb427ae2b tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:42.114303 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-e3a4ab3a-7acb-422a-b1b8-17bdb427ae2b tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:42.249369 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-e3a4ab3a-7acb-422a-b1b8-17bdb427ae2b tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:42.261786 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-e3a4ab3a-7acb-422a-b1b8-17bdb427ae2b tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:42.263296 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-e3a4ab3a-7acb-422a-b1b8-17bdb427ae2b tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:42.264539 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-e3a4ab3a-7acb-422a-b1b8-17bdb427ae2b tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1809 microversion: 2.20 time: 0.163379 Jun 07 14:44:42.265096 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 266/521] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:44:42 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:44:42.615626 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-b7f70aff-0c90-4040-aebf-def3fa8d495d tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:44:42.616266 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-b7f70aff-0c90-4040-aebf-def3fa8d495d tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 7dec201c-634b-4b93-bc30-0ac8e60795c7] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:44:42.623055 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-b7f70aff-0c90-4040-aebf-def3fa8d495d tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:42.623514 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-b7f70aff-0c90-4040-aebf-def3fa8d495d tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:42.624336 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-b7f70aff-0c90-4040-aebf-def3fa8d495d tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:42.624829 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-b7f70aff-0c90-4040-aebf-def3fa8d495d tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:42.780018 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-b7f70aff-0c90-4040-aebf-def3fa8d495d tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:42.790292 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-b7f70aff-0c90-4040-aebf-def3fa8d495d tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7" status: 200 len: 1734 microversion: 2.1 time: 0.178896 Jun 07 14:44:42.791553 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 256/522] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:44:42 2022] GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7 => generated 1734 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:44:43.284698 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-40d623d3-df09-4e89-99f7-dede7112f853 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:44:43.285407 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-40d623d3-df09-4e89-99f7-dede7112f853 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:44:43.293002 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-40d623d3-df09-4e89-99f7-dede7112f853 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:43.293447 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-40d623d3-df09-4e89-99f7-dede7112f853 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:43.294205 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-40d623d3-df09-4e89-99f7-dede7112f853 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:43.294638 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-40d623d3-df09-4e89-99f7-dede7112f853 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:43.451152 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-40d623d3-df09-4e89-99f7-dede7112f853 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:43.462334 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-40d623d3-df09-4e89-99f7-dede7112f853 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:43.465976 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-40d623d3-df09-4e89-99f7-dede7112f853 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:43.468716 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-40d623d3-df09-4e89-99f7-dede7112f853 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1809 microversion: 2.20 time: 0.187571 Jun 07 14:44:43.473079 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 267/523] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:44:43 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1809 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:44:43.810990 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-33d88704-c5a2-42bf-b17f-6192e3135ed2 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:44:43.811464 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-33d88704-c5a2-42bf-b17f-6192e3135ed2 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 7dec201c-634b-4b93-bc30-0ac8e60795c7] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:44:43.818683 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-33d88704-c5a2-42bf-b17f-6192e3135ed2 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:43.819129 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-33d88704-c5a2-42bf-b17f-6192e3135ed2 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:43.819922 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-33d88704-c5a2-42bf-b17f-6192e3135ed2 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:43.820352 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-33d88704-c5a2-42bf-b17f-6192e3135ed2 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:43.973112 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-33d88704-c5a2-42bf-b17f-6192e3135ed2 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:43.981172 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-33d88704-c5a2-42bf-b17f-6192e3135ed2 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7" status: 200 len: 1734 microversion: 2.1 time: 0.174238 Jun 07 14:44:43.986577 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 257/524] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:44:43 2022] GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7 => generated 1734 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:44:44.489740 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-049bd811-7f70-470a-b1e1-655d274509c0 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:44:44.490368 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-049bd811-7f70-470a-b1e1-655d274509c0 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:44:44.497153 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-049bd811-7f70-470a-b1e1-655d274509c0 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:44.501099 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-049bd811-7f70-470a-b1e1-655d274509c0 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:44.501099 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-049bd811-7f70-470a-b1e1-655d274509c0 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:44.501099 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-049bd811-7f70-470a-b1e1-655d274509c0 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:44.640274 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-049bd811-7f70-470a-b1e1-655d274509c0 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:44.655265 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-049bd811-7f70-470a-b1e1-655d274509c0 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:44.655265 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-049bd811-7f70-470a-b1e1-655d274509c0 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:44.655694 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-049bd811-7f70-470a-b1e1-655d274509c0 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1809 microversion: 2.20 time: 0.170458 Jun 07 14:44:44.656409 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 268/525] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:44:44 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:44:44.999293 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-17c2af0f-66f8-4ea9-82b8-c4fea2d6dc69 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:44:44.999910 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-17c2af0f-66f8-4ea9-82b8-c4fea2d6dc69 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 7dec201c-634b-4b93-bc30-0ac8e60795c7] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:44:45.006593 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-17c2af0f-66f8-4ea9-82b8-c4fea2d6dc69 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:45.007032 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-17c2af0f-66f8-4ea9-82b8-c4fea2d6dc69 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:45.007794 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-17c2af0f-66f8-4ea9-82b8-c4fea2d6dc69 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:45.008222 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-17c2af0f-66f8-4ea9-82b8-c4fea2d6dc69 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:45.149553 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-17c2af0f-66f8-4ea9-82b8-c4fea2d6dc69 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:45.157590 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-17c2af0f-66f8-4ea9-82b8-c4fea2d6dc69 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7" status: 200 len: 1734 microversion: 2.1 time: 0.162162 Jun 07 14:44:45.158148 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 258/526] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:44:44 2022] GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7 => generated 1734 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:44:45.674508 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-bc787920-d88d-456a-84ff-328225afbdef tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:44:45.675124 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-bc787920-d88d-456a-84ff-328225afbdef tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:44:45.682160 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-bc787920-d88d-456a-84ff-328225afbdef tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:45.682611 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-bc787920-d88d-456a-84ff-328225afbdef tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:45.683372 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-bc787920-d88d-456a-84ff-328225afbdef tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:45.683807 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-bc787920-d88d-456a-84ff-328225afbdef tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:45.822515 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-bc787920-d88d-456a-84ff-328225afbdef tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:45.830887 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-bc787920-d88d-456a-84ff-328225afbdef tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:45.832393 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-bc787920-d88d-456a-84ff-328225afbdef tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:45.834276 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-bc787920-d88d-456a-84ff-328225afbdef tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1809 microversion: 2.20 time: 0.163669 Jun 07 14:44:45.834832 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 269/527] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:44:45 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:44:46.174669 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-f3ce532c-c396-4fb0-a3be-8a9a5f117d67 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:44:46.175403 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-f3ce532c-c396-4fb0-a3be-8a9a5f117d67 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 7dec201c-634b-4b93-bc30-0ac8e60795c7] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:44:46.183638 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-f3ce532c-c396-4fb0-a3be-8a9a5f117d67 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:46.184098 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-f3ce532c-c396-4fb0-a3be-8a9a5f117d67 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:46.184913 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-f3ce532c-c396-4fb0-a3be-8a9a5f117d67 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:46.185359 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-f3ce532c-c396-4fb0-a3be-8a9a5f117d67 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:46.322189 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-f3ce532c-c396-4fb0-a3be-8a9a5f117d67 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:46.330190 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-f3ce532c-c396-4fb0-a3be-8a9a5f117d67 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7" status: 200 len: 1734 microversion: 2.1 time: 0.159446 Jun 07 14:44:46.330835 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 259/528] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:44:46 2022] GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7 => generated 1734 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:44:46.853755 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-adbf9f94-f854-4ce4-9d9b-c4edd00923a7 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:44:46.854602 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-adbf9f94-f854-4ce4-9d9b-c4edd00923a7 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:44:46.861245 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-adbf9f94-f854-4ce4-9d9b-c4edd00923a7 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:46.861688 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-adbf9f94-f854-4ce4-9d9b-c4edd00923a7 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:46.862473 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-adbf9f94-f854-4ce4-9d9b-c4edd00923a7 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:46.862896 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-adbf9f94-f854-4ce4-9d9b-c4edd00923a7 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:46.997529 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-adbf9f94-f854-4ce4-9d9b-c4edd00923a7 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:47.008144 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-adbf9f94-f854-4ce4-9d9b-c4edd00923a7 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:47.009851 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-adbf9f94-f854-4ce4-9d9b-c4edd00923a7 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:47.011036 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-adbf9f94-f854-4ce4-9d9b-c4edd00923a7 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1809 microversion: 2.20 time: 0.161226 Jun 07 14:44:47.011931 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 270/529] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:44:46 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:44:47.347233 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-8019488c-3623-4fc4-b68a-1331840d9b6a tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:44:47.348112 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-8019488c-3623-4fc4-b68a-1331840d9b6a tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 7dec201c-634b-4b93-bc30-0ac8e60795c7] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:44:47.354502 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-8019488c-3623-4fc4-b68a-1331840d9b6a tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:47.354943 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-8019488c-3623-4fc4-b68a-1331840d9b6a tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:47.355696 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-8019488c-3623-4fc4-b68a-1331840d9b6a tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:47.356127 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-8019488c-3623-4fc4-b68a-1331840d9b6a tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:47.488276 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-8019488c-3623-4fc4-b68a-1331840d9b6a tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:47.496303 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-8019488c-3623-4fc4-b68a-1331840d9b6a tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7" status: 200 len: 1734 microversion: 2.1 time: 0.152909 Jun 07 14:44:47.496900 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 260/530] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:44:47 2022] GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:44:48.032842 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-1d6029b9-5cb1-42d4-9355-ea243867d68a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:44:48.033707 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-1d6029b9-5cb1-42d4-9355-ea243867d68a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:44:48.042539 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-1d6029b9-5cb1-42d4-9355-ea243867d68a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:48.042988 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-1d6029b9-5cb1-42d4-9355-ea243867d68a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:48.043799 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-1d6029b9-5cb1-42d4-9355-ea243867d68a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:48.044196 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-1d6029b9-5cb1-42d4-9355-ea243867d68a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:48.199198 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-1d6029b9-5cb1-42d4-9355-ea243867d68a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:48.208810 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-1d6029b9-5cb1-42d4-9355-ea243867d68a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:48.210910 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-1d6029b9-5cb1-42d4-9355-ea243867d68a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:48.212090 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-1d6029b9-5cb1-42d4-9355-ea243867d68a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1809 microversion: 2.20 time: 0.183491 Jun 07 14:44:48.213007 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 271/531] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:44:48 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1809 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:44:48.514242 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-6eb6f8ef-9165-4865-882e-7031ca9d0a16 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:44:48.514917 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-6eb6f8ef-9165-4865-882e-7031ca9d0a16 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 7dec201c-634b-4b93-bc30-0ac8e60795c7] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:44:48.522198 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-6eb6f8ef-9165-4865-882e-7031ca9d0a16 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:48.522650 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-6eb6f8ef-9165-4865-882e-7031ca9d0a16 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:48.523422 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-6eb6f8ef-9165-4865-882e-7031ca9d0a16 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:48.523860 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-6eb6f8ef-9165-4865-882e-7031ca9d0a16 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:48.661411 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-6eb6f8ef-9165-4865-882e-7031ca9d0a16 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:48.670227 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-6eb6f8ef-9165-4865-882e-7031ca9d0a16 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7" status: 200 len: 1734 microversion: 2.1 time: 0.159783 Jun 07 14:44:48.670780 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 261/532] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:44:48 2022] GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7 => generated 1734 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:44:49.231124 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-613858bf-94a7-4188-b2d2-8f9cbc6c3e4e tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:44:49.231678 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-613858bf-94a7-4188-b2d2-8f9cbc6c3e4e tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:44:49.238328 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-613858bf-94a7-4188-b2d2-8f9cbc6c3e4e tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:49.238785 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-613858bf-94a7-4188-b2d2-8f9cbc6c3e4e tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:49.239559 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-613858bf-94a7-4188-b2d2-8f9cbc6c3e4e tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:49.240026 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-613858bf-94a7-4188-b2d2-8f9cbc6c3e4e tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:49.370433 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-613858bf-94a7-4188-b2d2-8f9cbc6c3e4e tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:49.379347 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-613858bf-94a7-4188-b2d2-8f9cbc6c3e4e tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:49.382109 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-613858bf-94a7-4188-b2d2-8f9cbc6c3e4e tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:49.383014 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-613858bf-94a7-4188-b2d2-8f9cbc6c3e4e tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1809 microversion: 2.20 time: 0.155731 Jun 07 14:44:49.383946 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 272/533] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:44:49 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:44:49.687286 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-6c302149-a49a-457b-907c-e17fcf59119a tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:44:49.687880 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-6c302149-a49a-457b-907c-e17fcf59119a tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 7dec201c-634b-4b93-bc30-0ac8e60795c7] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:44:49.694940 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-6c302149-a49a-457b-907c-e17fcf59119a tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:49.703663 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-6c302149-a49a-457b-907c-e17fcf59119a tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:49.703663 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-6c302149-a49a-457b-907c-e17fcf59119a tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:49.703663 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-6c302149-a49a-457b-907c-e17fcf59119a tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:49.835899 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-6c302149-a49a-457b-907c-e17fcf59119a tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:49.844313 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-6c302149-a49a-457b-907c-e17fcf59119a tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7" status: 200 len: 1734 microversion: 2.1 time: 0.161113 Jun 07 14:44:49.845244 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 262/534] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:44:49 2022] GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7 => generated 1734 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:44:50.402227 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-0832fd68-87c9-4285-8652-6b71e223a0b0 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:44:50.402965 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-0832fd68-87c9-4285-8652-6b71e223a0b0 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:44:50.409595 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-0832fd68-87c9-4285-8652-6b71e223a0b0 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:50.410055 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-0832fd68-87c9-4285-8652-6b71e223a0b0 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:50.410831 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-0832fd68-87c9-4285-8652-6b71e223a0b0 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:50.411276 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-0832fd68-87c9-4285-8652-6b71e223a0b0 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:50.544970 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-0832fd68-87c9-4285-8652-6b71e223a0b0 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:50.554204 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-0832fd68-87c9-4285-8652-6b71e223a0b0 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:50.555725 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-0832fd68-87c9-4285-8652-6b71e223a0b0 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:50.557015 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-0832fd68-87c9-4285-8652-6b71e223a0b0 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1809 microversion: 2.20 time: 0.159219 Jun 07 14:44:50.557769 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 273/535] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:44:50 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:44:50.862647 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-8ba39883-6d1c-48ce-972e-32c19193ae98 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:44:50.863389 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-8ba39883-6d1c-48ce-972e-32c19193ae98 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 7dec201c-634b-4b93-bc30-0ac8e60795c7] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:44:50.870517 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-8ba39883-6d1c-48ce-972e-32c19193ae98 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:50.870999 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-8ba39883-6d1c-48ce-972e-32c19193ae98 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:50.871772 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-8ba39883-6d1c-48ce-972e-32c19193ae98 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:50.872216 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-8ba39883-6d1c-48ce-972e-32c19193ae98 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:51.024762 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-8ba39883-6d1c-48ce-972e-32c19193ae98 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:51.034025 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-8ba39883-6d1c-48ce-972e-32c19193ae98 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7" status: 200 len: 1734 microversion: 2.1 time: 0.175530 Jun 07 14:44:51.035085 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 263/536] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:44:50 2022] GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7 => generated 1734 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:44:51.575116 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-f793008b-571f-4f0d-a60a-8c32c329bf3b tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:44:51.575748 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-f793008b-571f-4f0d-a60a-8c32c329bf3b tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:44:51.582339 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-f793008b-571f-4f0d-a60a-8c32c329bf3b tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:51.582819 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-f793008b-571f-4f0d-a60a-8c32c329bf3b tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:51.583582 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-f793008b-571f-4f0d-a60a-8c32c329bf3b tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:51.584582 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-f793008b-571f-4f0d-a60a-8c32c329bf3b tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:51.715454 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-f793008b-571f-4f0d-a60a-8c32c329bf3b tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:51.723872 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-f793008b-571f-4f0d-a60a-8c32c329bf3b tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:51.726034 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-f793008b-571f-4f0d-a60a-8c32c329bf3b tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:51.727187 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-f793008b-571f-4f0d-a60a-8c32c329bf3b tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1809 microversion: 2.20 time: 0.156065 Jun 07 14:44:51.727743 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 274/537] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:44:51 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:44:52.051670 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-9f6cbcdf-1f13-4979-9193-61e839371dfb tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:44:52.052286 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-9f6cbcdf-1f13-4979-9193-61e839371dfb tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 7dec201c-634b-4b93-bc30-0ac8e60795c7] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:44:52.059456 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-9f6cbcdf-1f13-4979-9193-61e839371dfb tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:52.059854 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-9f6cbcdf-1f13-4979-9193-61e839371dfb tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:52.060650 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-9f6cbcdf-1f13-4979-9193-61e839371dfb tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:52.061088 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-9f6cbcdf-1f13-4979-9193-61e839371dfb tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:52.192876 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-9f6cbcdf-1f13-4979-9193-61e839371dfb tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:52.201515 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-9f6cbcdf-1f13-4979-9193-61e839371dfb tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7" status: 200 len: 1734 microversion: 2.1 time: 0.153652 Jun 07 14:44:52.202078 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 264/538] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:44:52 2022] GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:44:52.746175 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-5df5dad7-9076-4753-a065-2b39d573931a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:44:52.746791 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-5df5dad7-9076-4753-a065-2b39d573931a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:44:52.753352 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5df5dad7-9076-4753-a065-2b39d573931a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:52.753809 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5df5dad7-9076-4753-a065-2b39d573931a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:52.754569 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5df5dad7-9076-4753-a065-2b39d573931a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:52.755009 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5df5dad7-9076-4753-a065-2b39d573931a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:52.885586 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-5df5dad7-9076-4753-a065-2b39d573931a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:52.894016 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-5df5dad7-9076-4753-a065-2b39d573931a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:52.895791 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-5df5dad7-9076-4753-a065-2b39d573931a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:52.896985 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-5df5dad7-9076-4753-a065-2b39d573931a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1809 microversion: 2.20 time: 0.154708 Jun 07 14:44:52.897542 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 275/539] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:44:52 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 14:44:53.218465 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-947c38a1-3ada-412c-afb5-94c5a851d724 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:44:53.219093 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-947c38a1-3ada-412c-afb5-94c5a851d724 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 7dec201c-634b-4b93-bc30-0ac8e60795c7] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:44:53.226178 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-947c38a1-3ada-412c-afb5-94c5a851d724 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:53.226640 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-947c38a1-3ada-412c-afb5-94c5a851d724 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:53.227438 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-947c38a1-3ada-412c-afb5-94c5a851d724 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:53.227878 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-947c38a1-3ada-412c-afb5-94c5a851d724 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:53.358105 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-947c38a1-3ada-412c-afb5-94c5a851d724 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:53.366446 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-947c38a1-3ada-412c-afb5-94c5a851d724 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7" status: 200 len: 1734 microversion: 2.1 time: 0.151763 Jun 07 14:44:53.367013 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 265/540] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:44:53 2022] GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:44:53.915984 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-4dfde6c0-0c85-4838-bf4b-7d9a7cf13a0a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:44:53.916621 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-4dfde6c0-0c85-4838-bf4b-7d9a7cf13a0a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:44:53.923479 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-4dfde6c0-0c85-4838-bf4b-7d9a7cf13a0a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:53.923865 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-4dfde6c0-0c85-4838-bf4b-7d9a7cf13a0a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:53.924687 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-4dfde6c0-0c85-4838-bf4b-7d9a7cf13a0a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:53.925124 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-4dfde6c0-0c85-4838-bf4b-7d9a7cf13a0a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:54.057010 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-4dfde6c0-0c85-4838-bf4b-7d9a7cf13a0a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:54.065293 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-4dfde6c0-0c85-4838-bf4b-7d9a7cf13a0a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:54.066751 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-4dfde6c0-0c85-4838-bf4b-7d9a7cf13a0a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:54.067899 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-4dfde6c0-0c85-4838-bf4b-7d9a7cf13a0a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1809 microversion: 2.20 time: 0.156442 Jun 07 14:44:54.069095 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 276/541] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:44:53 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:44:54.383970 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-fdf0cd80-8b28-47fc-bb0f-0378742f02ef tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:44:54.384529 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-fdf0cd80-8b28-47fc-bb0f-0378742f02ef tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 7dec201c-634b-4b93-bc30-0ac8e60795c7] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:44:54.391041 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-fdf0cd80-8b28-47fc-bb0f-0378742f02ef tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:54.391498 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-fdf0cd80-8b28-47fc-bb0f-0378742f02ef tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:54.392261 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-fdf0cd80-8b28-47fc-bb0f-0378742f02ef tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:54.392722 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-fdf0cd80-8b28-47fc-bb0f-0378742f02ef tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:54.523012 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-fdf0cd80-8b28-47fc-bb0f-0378742f02ef tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:54.531226 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-fdf0cd80-8b28-47fc-bb0f-0378742f02ef tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7" status: 200 len: 1734 microversion: 2.1 time: 0.151756 Jun 07 14:44:54.532495 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 266/542] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:44:54 2022] GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:44:55.086983 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-a622488f-69a0-4d75-8933-899e83ad8119 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:44:55.087603 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-a622488f-69a0-4d75-8933-899e83ad8119 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:44:55.094096 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-a622488f-69a0-4d75-8933-899e83ad8119 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:55.094551 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-a622488f-69a0-4d75-8933-899e83ad8119 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:55.095316 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-a622488f-69a0-4d75-8933-899e83ad8119 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:55.095756 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-a622488f-69a0-4d75-8933-899e83ad8119 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:55.221882 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-a622488f-69a0-4d75-8933-899e83ad8119 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:55.230847 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-a622488f-69a0-4d75-8933-899e83ad8119 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:55.232354 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-a622488f-69a0-4d75-8933-899e83ad8119 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:55.233566 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-a622488f-69a0-4d75-8933-899e83ad8119 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1809 microversion: 2.20 time: 0.150520 Jun 07 14:44:55.234120 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 277/543] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:44:55 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1809 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:44:55.548472 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-f1a9a8a3-7458-4e32-a60f-c3d3f22bf03c tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:44:55.549117 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-f1a9a8a3-7458-4e32-a60f-c3d3f22bf03c tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 7dec201c-634b-4b93-bc30-0ac8e60795c7] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:44:55.556291 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-f1a9a8a3-7458-4e32-a60f-c3d3f22bf03c tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:55.556763 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-f1a9a8a3-7458-4e32-a60f-c3d3f22bf03c tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:55.557524 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-f1a9a8a3-7458-4e32-a60f-c3d3f22bf03c tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:55.558508 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-f1a9a8a3-7458-4e32-a60f-c3d3f22bf03c tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:55.692303 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-f1a9a8a3-7458-4e32-a60f-c3d3f22bf03c tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:55.700753 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-f1a9a8a3-7458-4e32-a60f-c3d3f22bf03c tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7" status: 200 len: 1734 microversion: 2.1 time: 0.156320 Jun 07 14:44:55.701316 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 267/544] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:44:55 2022] GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7 => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:44:56.252274 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-2ac09fd0-d115-433f-b1f9-c0a105668fa9 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:44:56.253034 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-2ac09fd0-d115-433f-b1f9-c0a105668fa9 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:44:56.260218 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-2ac09fd0-d115-433f-b1f9-c0a105668fa9 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:56.260704 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-2ac09fd0-d115-433f-b1f9-c0a105668fa9 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:56.261512 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-2ac09fd0-d115-433f-b1f9-c0a105668fa9 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:56.261956 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-2ac09fd0-d115-433f-b1f9-c0a105668fa9 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:56.398019 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-2ac09fd0-d115-433f-b1f9-c0a105668fa9 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:56.401541 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG dbcounter [-] [118158] Writing DB stats nova_cell1:SELECT=100 {{(pid=118158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:44:56.406782 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-2ac09fd0-d115-433f-b1f9-c0a105668fa9 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:56.408286 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-2ac09fd0-d115-433f-b1f9-c0a105668fa9 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:56.409471 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-2ac09fd0-d115-433f-b1f9-c0a105668fa9 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1809 microversion: 2.20 time: 0.161253 Jun 07 14:44:56.410028 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 278/545] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:44:56 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:44:56.718351 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-b69e3c37-6c86-425b-8c96-e23e8816c5c3 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:44:56.718966 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-b69e3c37-6c86-425b-8c96-e23e8816c5c3 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 7dec201c-634b-4b93-bc30-0ac8e60795c7] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:44:56.725560 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-b69e3c37-6c86-425b-8c96-e23e8816c5c3 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:56.726016 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-b69e3c37-6c86-425b-8c96-e23e8816c5c3 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:56.726792 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-b69e3c37-6c86-425b-8c96-e23e8816c5c3 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:56.727279 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-b69e3c37-6c86-425b-8c96-e23e8816c5c3 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:56.856069 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-b69e3c37-6c86-425b-8c96-e23e8816c5c3 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:56.863954 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-b69e3c37-6c86-425b-8c96-e23e8816c5c3 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7" status: 200 len: 1734 microversion: 2.1 time: 0.149451 Jun 07 14:44:56.864536 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 268/546] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:44:56 2022] GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:44:57.430675 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-9a2c77b6-6ecf-4649-bdf7-74a60ef2cb03 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:44:57.431309 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-9a2c77b6-6ecf-4649-bdf7-74a60ef2cb03 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:44:57.438212 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-9a2c77b6-6ecf-4649-bdf7-74a60ef2cb03 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:57.438670 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-9a2c77b6-6ecf-4649-bdf7-74a60ef2cb03 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:57.439442 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-9a2c77b6-6ecf-4649-bdf7-74a60ef2cb03 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:57.439881 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-9a2c77b6-6ecf-4649-bdf7-74a60ef2cb03 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:57.566770 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-9a2c77b6-6ecf-4649-bdf7-74a60ef2cb03 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:57.575814 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-9a2c77b6-6ecf-4649-bdf7-74a60ef2cb03 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:57.577299 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-9a2c77b6-6ecf-4649-bdf7-74a60ef2cb03 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:57.578454 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-9a2c77b6-6ecf-4649-bdf7-74a60ef2cb03 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1809 microversion: 2.20 time: 0.154005 Jun 07 14:44:57.579006 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 279/547] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:44:57 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:44:57.881611 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-add9cd70-325c-4c14-a67c-3e63f75f5361 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:44:57.882146 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-add9cd70-325c-4c14-a67c-3e63f75f5361 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 7dec201c-634b-4b93-bc30-0ac8e60795c7] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:44:57.888531 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-add9cd70-325c-4c14-a67c-3e63f75f5361 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:57.889005 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-add9cd70-325c-4c14-a67c-3e63f75f5361 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:57.889782 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-add9cd70-325c-4c14-a67c-3e63f75f5361 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:57.890208 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-add9cd70-325c-4c14-a67c-3e63f75f5361 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:58.021309 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-add9cd70-325c-4c14-a67c-3e63f75f5361 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:58.029490 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-add9cd70-325c-4c14-a67c-3e63f75f5361 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7" status: 200 len: 1734 microversion: 2.1 time: 0.152270 Jun 07 14:44:58.029829 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 269/548] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:44:57 2022] GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:44:58.596836 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-9a8fe98f-c51d-4a31-9881-d793da05c247 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:44:58.597449 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-9a8fe98f-c51d-4a31-9881-d793da05c247 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:44:58.604123 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-9a8fe98f-c51d-4a31-9881-d793da05c247 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:58.604618 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-9a8fe98f-c51d-4a31-9881-d793da05c247 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:58.605392 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-9a8fe98f-c51d-4a31-9881-d793da05c247 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:58.605841 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-9a8fe98f-c51d-4a31-9881-d793da05c247 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:58.750788 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-9a8fe98f-c51d-4a31-9881-d793da05c247 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:58.763142 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-9a8fe98f-c51d-4a31-9881-d793da05c247 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:58.764703 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-9a8fe98f-c51d-4a31-9881-d793da05c247 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:58.765970 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-9a8fe98f-c51d-4a31-9881-d793da05c247 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1809 microversion: 2.20 time: 0.172991 Jun 07 14:44:58.767321 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 280/549] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:44:58 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1809 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:44:59.053359 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-cb52a961-0e9e-4183-bf4e-7c8c675f0ec9 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:44:59.053359 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-cb52a961-0e9e-4183-bf4e-7c8c675f0ec9 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 7dec201c-634b-4b93-bc30-0ac8e60795c7] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:44:59.059387 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-cb52a961-0e9e-4183-bf4e-7c8c675f0ec9 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:59.059827 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-cb52a961-0e9e-4183-bf4e-7c8c675f0ec9 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:59.060778 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-cb52a961-0e9e-4183-bf4e-7c8c675f0ec9 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:59.061349 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-cb52a961-0e9e-4183-bf4e-7c8c675f0ec9 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:59.220694 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-cb52a961-0e9e-4183-bf4e-7c8c675f0ec9 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:59.228924 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-cb52a961-0e9e-4183-bf4e-7c8c675f0ec9 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7" status: 200 len: 1734 microversion: 2.1 time: 0.185460 Jun 07 14:44:59.230141 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 270/550] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:44:59 2022] GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7 => generated 1734 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:44:59.787817 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-fcdf0b89-5993-4552-b97c-1271822345bf tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:44:59.788457 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-fcdf0b89-5993-4552-b97c-1271822345bf tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:44:59.795052 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-fcdf0b89-5993-4552-b97c-1271822345bf tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:59.795507 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-fcdf0b89-5993-4552-b97c-1271822345bf tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:59.796273 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-fcdf0b89-5993-4552-b97c-1271822345bf tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:44:59.796739 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-fcdf0b89-5993-4552-b97c-1271822345bf tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:44:59.932098 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-fcdf0b89-5993-4552-b97c-1271822345bf tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:59.941510 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-fcdf0b89-5993-4552-b97c-1271822345bf tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:59.943005 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-fcdf0b89-5993-4552-b97c-1271822345bf tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:44:59.944214 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-fcdf0b89-5993-4552-b97c-1271822345bf tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1809 microversion: 2.20 time: 0.160918 Jun 07 14:44:59.944803 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 281/551] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:44:59 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:45:00.246103 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-385c6dfd-98f6-4ac8-8add-bf7ced7659e1 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:45:00.246742 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-385c6dfd-98f6-4ac8-8add-bf7ced7659e1 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 7dec201c-634b-4b93-bc30-0ac8e60795c7] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:45:00.249190 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG dbcounter [-] [118157] Writing DB stats nova_api:SELECT=62 {{(pid=118157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:45:00.253972 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-385c6dfd-98f6-4ac8-8add-bf7ced7659e1 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:00.254485 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-385c6dfd-98f6-4ac8-8add-bf7ced7659e1 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:00.257755 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-385c6dfd-98f6-4ac8-8add-bf7ced7659e1 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:00.257755 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-385c6dfd-98f6-4ac8-8add-bf7ced7659e1 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:00.260449 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG dbcounter [-] [118157] Writing DB stats nova_cell1:SELECT=100 {{(pid=118157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:45:00.389871 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-385c6dfd-98f6-4ac8-8add-bf7ced7659e1 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:00.398890 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-385c6dfd-98f6-4ac8-8add-bf7ced7659e1 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7" status: 200 len: 1734 microversion: 2.1 time: 0.156645 Jun 07 14:45:00.399452 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 271/552] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:45:00 2022] GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7 => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:45:00.964311 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-09b8cdbe-1bef-4ade-a3da-9ef5b3e727f2 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:45:00.964945 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-09b8cdbe-1bef-4ade-a3da-9ef5b3e727f2 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:45:00.971484 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-09b8cdbe-1bef-4ade-a3da-9ef5b3e727f2 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:00.971922 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-09b8cdbe-1bef-4ade-a3da-9ef5b3e727f2 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:00.972720 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-09b8cdbe-1bef-4ade-a3da-9ef5b3e727f2 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:00.973154 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-09b8cdbe-1bef-4ade-a3da-9ef5b3e727f2 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:01.109953 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-09b8cdbe-1bef-4ade-a3da-9ef5b3e727f2 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:01.121235 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-09b8cdbe-1bef-4ade-a3da-9ef5b3e727f2 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:01.122814 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-09b8cdbe-1bef-4ade-a3da-9ef5b3e727f2 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:01.123978 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-09b8cdbe-1bef-4ade-a3da-9ef5b3e727f2 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1809 microversion: 2.20 time: 0.164710 Jun 07 14:45:01.124573 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 282/553] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:45:00 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:45:01.416270 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-6cf78fbd-5873-4c92-bcfe-f3eb0705d137 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:45:01.416833 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-6cf78fbd-5873-4c92-bcfe-f3eb0705d137 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 7dec201c-634b-4b93-bc30-0ac8e60795c7] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:45:01.423506 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-6cf78fbd-5873-4c92-bcfe-f3eb0705d137 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:01.423964 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-6cf78fbd-5873-4c92-bcfe-f3eb0705d137 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:01.424761 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-6cf78fbd-5873-4c92-bcfe-f3eb0705d137 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:01.425201 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-6cf78fbd-5873-4c92-bcfe-f3eb0705d137 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:01.552089 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-6cf78fbd-5873-4c92-bcfe-f3eb0705d137 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:01.560896 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-6cf78fbd-5873-4c92-bcfe-f3eb0705d137 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7" status: 200 len: 1734 microversion: 2.1 time: 0.148701 Jun 07 14:45:01.561456 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 272/554] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:45:01 2022] GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7 => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:45:02.142225 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-167ccc7f-f1a3-4b50-89f1-06f95a2260bb tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:45:02.142842 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-167ccc7f-f1a3-4b50-89f1-06f95a2260bb tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:45:02.145566 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG dbcounter [-] [118158] Writing DB stats nova_api:SELECT=58 {{(pid=118158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:45:02.150841 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-167ccc7f-f1a3-4b50-89f1-06f95a2260bb tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:02.151295 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-167ccc7f-f1a3-4b50-89f1-06f95a2260bb tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:02.152072 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-167ccc7f-f1a3-4b50-89f1-06f95a2260bb tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:02.152557 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-167ccc7f-f1a3-4b50-89f1-06f95a2260bb tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:02.283219 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-167ccc7f-f1a3-4b50-89f1-06f95a2260bb tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:02.291763 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-167ccc7f-f1a3-4b50-89f1-06f95a2260bb tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:02.293290 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-167ccc7f-f1a3-4b50-89f1-06f95a2260bb tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:02.294443 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-167ccc7f-f1a3-4b50-89f1-06f95a2260bb tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1809 microversion: 2.20 time: 0.156121 Jun 07 14:45:02.295018 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 283/555] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:45:02 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:45:02.577891 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-74684ac6-5479-47cc-bab4-ba0b1a179fcb tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:45:02.578540 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-74684ac6-5479-47cc-bab4-ba0b1a179fcb tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 7dec201c-634b-4b93-bc30-0ac8e60795c7] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:45:02.585799 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-74684ac6-5479-47cc-bab4-ba0b1a179fcb tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:02.586249 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-74684ac6-5479-47cc-bab4-ba0b1a179fcb tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:02.587023 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-74684ac6-5479-47cc-bab4-ba0b1a179fcb tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:02.587464 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-74684ac6-5479-47cc-bab4-ba0b1a179fcb tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:02.715886 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-74684ac6-5479-47cc-bab4-ba0b1a179fcb tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:02.723870 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-74684ac6-5479-47cc-bab4-ba0b1a179fcb tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7" status: 200 len: 1734 microversion: 2.1 time: 0.149786 Jun 07 14:45:02.724441 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 273/556] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:45:02 2022] GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:45:03.312686 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-74481412-2b97-4fa4-83f0-6213eb189ffb tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:45:03.313291 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-74481412-2b97-4fa4-83f0-6213eb189ffb tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:45:03.319681 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-74481412-2b97-4fa4-83f0-6213eb189ffb tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:03.320123 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-74481412-2b97-4fa4-83f0-6213eb189ffb tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:03.320899 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-74481412-2b97-4fa4-83f0-6213eb189ffb tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:03.321330 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-74481412-2b97-4fa4-83f0-6213eb189ffb tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:03.449336 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-74481412-2b97-4fa4-83f0-6213eb189ffb tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:03.457628 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-74481412-2b97-4fa4-83f0-6213eb189ffb tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:03.459142 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-74481412-2b97-4fa4-83f0-6213eb189ffb tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:03.460834 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-74481412-2b97-4fa4-83f0-6213eb189ffb tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1809 microversion: 2.20 time: 0.151573 Jun 07 14:45:03.461439 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 284/557] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:45:03 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 14:45:03.741088 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-317ca7f6-825f-48cc-ac6b-717456fbcb50 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:45:03.741731 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-317ca7f6-825f-48cc-ac6b-717456fbcb50 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 7dec201c-634b-4b93-bc30-0ac8e60795c7] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:45:03.748322 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-317ca7f6-825f-48cc-ac6b-717456fbcb50 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:03.748798 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-317ca7f6-825f-48cc-ac6b-717456fbcb50 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:03.749566 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-317ca7f6-825f-48cc-ac6b-717456fbcb50 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:03.750004 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-317ca7f6-825f-48cc-ac6b-717456fbcb50 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:03.875371 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-317ca7f6-825f-48cc-ac6b-717456fbcb50 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:03.883740 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-317ca7f6-825f-48cc-ac6b-717456fbcb50 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7" status: 200 len: 1734 microversion: 2.1 time: 0.146500 Jun 07 14:45:03.884292 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 274/558] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:45:03 2022] GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7 => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:45:04.480829 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-4b24408b-dd53-4f59-9e55-f445740d1bf8 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:45:04.481461 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-4b24408b-dd53-4f59-9e55-f445740d1bf8 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:45:04.487802 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-4b24408b-dd53-4f59-9e55-f445740d1bf8 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:04.488247 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-4b24408b-dd53-4f59-9e55-f445740d1bf8 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:04.489066 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-4b24408b-dd53-4f59-9e55-f445740d1bf8 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:04.489463 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-4b24408b-dd53-4f59-9e55-f445740d1bf8 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:04.620502 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-4b24408b-dd53-4f59-9e55-f445740d1bf8 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:04.628965 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-4b24408b-dd53-4f59-9e55-f445740d1bf8 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:04.630550 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-4b24408b-dd53-4f59-9e55-f445740d1bf8 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:04.631708 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-4b24408b-dd53-4f59-9e55-f445740d1bf8 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1809 microversion: 2.20 time: 0.154760 Jun 07 14:45:04.632428 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 285/559] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:45:04 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:45:04.685131 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-190d822b-fc7e-4bcb-a90b-de576246e659 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:45:04.685636 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-190d822b-fc7e-4bcb-a90b-de576246e659 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:45:04.691536 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-190d822b-fc7e-4bcb-a90b-de576246e659 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:04.691988 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-190d822b-fc7e-4bcb-a90b-de576246e659 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:04.692789 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-190d822b-fc7e-4bcb-a90b-de576246e659 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:04.693232 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-190d822b-fc7e-4bcb-a90b-de576246e659 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:04.818090 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.objects.instance [None req-190d822b-fc7e-4bcb-a90b-de576246e659 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lazy-loading 'services' on Instance uuid e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 {{(pid=118157) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 14:45:04.901464 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-6b6fa6a2-613a-448f-98b3-a158e5dffc2a tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:45:04.901999 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-6b6fa6a2-613a-448f-98b3-a158e5dffc2a tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 7dec201c-634b-4b93-bc30-0ac8e60795c7] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:45:04.907927 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-6b6fa6a2-613a-448f-98b3-a158e5dffc2a tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:04.908397 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-6b6fa6a2-613a-448f-98b3-a158e5dffc2a tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:04.909177 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-6b6fa6a2-613a-448f-98b3-a158e5dffc2a tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:04.909608 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-6b6fa6a2-613a-448f-98b3-a158e5dffc2a tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:05.038149 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-6b6fa6a2-613a-448f-98b3-a158e5dffc2a tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:05.042597 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-190d822b-fc7e-4bcb-a90b-de576246e659 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "DELETE /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6/os-volume_attachments/e06763a2-3cd2-4088-806b-e7c9c8bb300f" status: 202 len: 0 microversion: 2.1 time: 0.460803 Jun 07 14:45:05.044771 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 275/560] 10.222.0.85 () {58 vars in 1415 bytes} [Tue Jun 7 14:45:04 2022] DELETE /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6/os-volume_attachments/e06763a2-3cd2-4088-806b-e7c9c8bb300f => generated 0 bytes in 462 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 07 14:45:05.046435 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-6b6fa6a2-613a-448f-98b3-a158e5dffc2a tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7" status: 200 len: 1734 microversion: 2.1 time: 0.149195 Jun 07 14:45:05.047010 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 286/561] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:45:04 2022] GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:45:05.651593 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-adfd39dd-3120-4837-9f09-c693e5526b01 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:45:05.652533 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-adfd39dd-3120-4837-9f09-c693e5526b01 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:45:05.658851 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-adfd39dd-3120-4837-9f09-c693e5526b01 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:05.659297 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-adfd39dd-3120-4837-9f09-c693e5526b01 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:05.660055 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-adfd39dd-3120-4837-9f09-c693e5526b01 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:05.660512 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-adfd39dd-3120-4837-9f09-c693e5526b01 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:05.798051 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-adfd39dd-3120-4837-9f09-c693e5526b01 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:05.807046 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-adfd39dd-3120-4837-9f09-c693e5526b01 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:05.808562 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-adfd39dd-3120-4837-9f09-c693e5526b01 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:05.809740 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-adfd39dd-3120-4837-9f09-c693e5526b01 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1809 microversion: 2.20 time: 0.163223 Jun 07 14:45:05.810281 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 276/562] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:45:05 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:45:06.063140 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-0a9cb973-9ee1-441a-ac01-16b6efff8f4a tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:45:06.063790 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-0a9cb973-9ee1-441a-ac01-16b6efff8f4a tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 7dec201c-634b-4b93-bc30-0ac8e60795c7] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:45:06.070353 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-0a9cb973-9ee1-441a-ac01-16b6efff8f4a tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:06.071660 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-0a9cb973-9ee1-441a-ac01-16b6efff8f4a tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:06.072117 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-0a9cb973-9ee1-441a-ac01-16b6efff8f4a tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:06.072552 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-0a9cb973-9ee1-441a-ac01-16b6efff8f4a tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:06.204706 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-0a9cb973-9ee1-441a-ac01-16b6efff8f4a tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:06.213724 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-0a9cb973-9ee1-441a-ac01-16b6efff8f4a tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7" status: 200 len: 1734 microversion: 2.1 time: 0.154386 Jun 07 14:45:06.214233 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 287/563] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:45:06 2022] GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:45:06.828703 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-31735595-f02d-4dc4-b740-811b9eaea1e4 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:45:06.829319 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-31735595-f02d-4dc4-b740-811b9eaea1e4 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:45:06.835777 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-31735595-f02d-4dc4-b740-811b9eaea1e4 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:06.836350 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-31735595-f02d-4dc4-b740-811b9eaea1e4 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:06.837650 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-31735595-f02d-4dc4-b740-811b9eaea1e4 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:06.838093 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-31735595-f02d-4dc4-b740-811b9eaea1e4 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:06.968667 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-31735595-f02d-4dc4-b740-811b9eaea1e4 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:06.977071 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-31735595-f02d-4dc4-b740-811b9eaea1e4 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:06.978564 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-31735595-f02d-4dc4-b740-811b9eaea1e4 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:06.979706 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-31735595-f02d-4dc4-b740-811b9eaea1e4 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1809 microversion: 2.20 time: 0.154968 Jun 07 14:45:06.980259 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 277/564] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:45:06 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:45:07.171212 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 14:45:07.171370 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Tue Jun 7 14:45:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 07 14:45:07.230195 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-662c21ab-88e0-4f04-961f-221ad6881afd tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:45:07.230800 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-662c21ab-88e0-4f04-961f-221ad6881afd tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 7dec201c-634b-4b93-bc30-0ac8e60795c7] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:45:07.237189 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-662c21ab-88e0-4f04-961f-221ad6881afd tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:07.237636 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-662c21ab-88e0-4f04-961f-221ad6881afd tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:07.238387 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-662c21ab-88e0-4f04-961f-221ad6881afd tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:07.238814 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-662c21ab-88e0-4f04-961f-221ad6881afd tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:07.363265 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-662c21ab-88e0-4f04-961f-221ad6881afd tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:07.371895 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-662c21ab-88e0-4f04-961f-221ad6881afd tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7" status: 200 len: 1734 microversion: 2.1 time: 0.145532 Jun 07 14:45:07.372484 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 288/565] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:45:07 2022] GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7 => generated 1734 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:45:07.998142 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-7932b35f-deca-49ad-9bf7-33a00423f370 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:45:07.998759 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-7932b35f-deca-49ad-9bf7-33a00423f370 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:45:08.005289 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-7932b35f-deca-49ad-9bf7-33a00423f370 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:08.005733 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-7932b35f-deca-49ad-9bf7-33a00423f370 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:08.006496 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-7932b35f-deca-49ad-9bf7-33a00423f370 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:08.006934 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-7932b35f-deca-49ad-9bf7-33a00423f370 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:08.135760 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-7932b35f-deca-49ad-9bf7-33a00423f370 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:08.147353 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-7932b35f-deca-49ad-9bf7-33a00423f370 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:08.149428 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-7932b35f-deca-49ad-9bf7-33a00423f370 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:08.152420 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-7932b35f-deca-49ad-9bf7-33a00423f370 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1809 microversion: 2.20 time: 0.158205 Jun 07 14:45:08.152969 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 278/566] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:45:07 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:45:08.388981 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-7f46d0fd-063c-4e15-9d10-b963d577bade tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:45:08.389598 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-7f46d0fd-063c-4e15-9d10-b963d577bade tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 7dec201c-634b-4b93-bc30-0ac8e60795c7] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:45:08.396312 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-7f46d0fd-063c-4e15-9d10-b963d577bade tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:08.396805 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-7f46d0fd-063c-4e15-9d10-b963d577bade tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:08.397573 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-7f46d0fd-063c-4e15-9d10-b963d577bade tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:08.398063 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-7f46d0fd-063c-4e15-9d10-b963d577bade tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:08.528277 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-7f46d0fd-063c-4e15-9d10-b963d577bade tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:08.536183 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-7f46d0fd-063c-4e15-9d10-b963d577bade tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7" status: 200 len: 1734 microversion: 2.1 time: 0.151146 Jun 07 14:45:08.536773 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 289/567] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:45:08 2022] GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:45:09.171817 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-4a97f1e9-1388-4cdf-ae2a-e01344183c50 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:45:09.172384 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-4a97f1e9-1388-4cdf-ae2a-e01344183c50 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:45:09.178467 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-4a97f1e9-1388-4cdf-ae2a-e01344183c50 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:09.178919 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-4a97f1e9-1388-4cdf-ae2a-e01344183c50 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:09.179689 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-4a97f1e9-1388-4cdf-ae2a-e01344183c50 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:09.180792 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-4a97f1e9-1388-4cdf-ae2a-e01344183c50 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:09.312512 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-4a97f1e9-1388-4cdf-ae2a-e01344183c50 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:09.320905 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-4a97f1e9-1388-4cdf-ae2a-e01344183c50 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:09.322396 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-4a97f1e9-1388-4cdf-ae2a-e01344183c50 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:09.323543 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-4a97f1e9-1388-4cdf-ae2a-e01344183c50 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1809 microversion: 2.20 time: 0.155879 Jun 07 14:45:09.324345 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 279/568] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:45:09 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:45:09.553683 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-e2a31930-a3f4-4a93-8f8f-a8c3232ac7b8 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:45:09.554287 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-e2a31930-a3f4-4a93-8f8f-a8c3232ac7b8 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 7dec201c-634b-4b93-bc30-0ac8e60795c7] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:45:09.561380 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-e2a31930-a3f4-4a93-8f8f-a8c3232ac7b8 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:09.561834 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-e2a31930-a3f4-4a93-8f8f-a8c3232ac7b8 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:09.562629 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-e2a31930-a3f4-4a93-8f8f-a8c3232ac7b8 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:09.563067 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-e2a31930-a3f4-4a93-8f8f-a8c3232ac7b8 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:09.915863 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-e2a31930-a3f4-4a93-8f8f-a8c3232ac7b8 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:09.923731 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-e2a31930-a3f4-4a93-8f8f-a8c3232ac7b8 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7" status: 200 len: 1734 microversion: 2.1 time: 0.373894 Jun 07 14:45:09.924305 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 290/569] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:45:09 2022] GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7 => generated 1734 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:45:10.343116 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-6fe39f23-cc29-4391-880e-2ee9fbda2466 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:45:10.344798 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-6fe39f23-cc29-4391-880e-2ee9fbda2466 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:45:10.351020 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-6fe39f23-cc29-4391-880e-2ee9fbda2466 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:10.351475 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-6fe39f23-cc29-4391-880e-2ee9fbda2466 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:10.352239 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-6fe39f23-cc29-4391-880e-2ee9fbda2466 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:10.352870 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-6fe39f23-cc29-4391-880e-2ee9fbda2466 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:10.482187 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-6fe39f23-cc29-4391-880e-2ee9fbda2466 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:10.490933 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-6fe39f23-cc29-4391-880e-2ee9fbda2466 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:10.492480 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-6fe39f23-cc29-4391-880e-2ee9fbda2466 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:10.494187 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-6fe39f23-cc29-4391-880e-2ee9fbda2466 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1809 microversion: 2.20 time: 0.155371 Jun 07 14:45:10.494735 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 280/570] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:45:10 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:45:10.940738 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-e4e31397-44f9-451d-ab3d-cc8d980651f2 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:45:10.941363 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-e4e31397-44f9-451d-ab3d-cc8d980651f2 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 7dec201c-634b-4b93-bc30-0ac8e60795c7] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:45:10.947851 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-e4e31397-44f9-451d-ab3d-cc8d980651f2 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:10.948307 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-e4e31397-44f9-451d-ab3d-cc8d980651f2 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:10.949102 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-e4e31397-44f9-451d-ab3d-cc8d980651f2 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:10.949536 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-e4e31397-44f9-451d-ab3d-cc8d980651f2 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:11.078766 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-e4e31397-44f9-451d-ab3d-cc8d980651f2 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:11.086775 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-e4e31397-44f9-451d-ab3d-cc8d980651f2 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7" status: 200 len: 1734 microversion: 2.1 time: 0.150128 Jun 07 14:45:11.092355 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 291/571] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:45:10 2022] GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:45:11.513209 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-6d8c4e56-79a6-4aab-8202-08e9bdda3edf tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:45:11.513809 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-6d8c4e56-79a6-4aab-8202-08e9bdda3edf tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:45:11.520552 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-6d8c4e56-79a6-4aab-8202-08e9bdda3edf tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:11.520991 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-6d8c4e56-79a6-4aab-8202-08e9bdda3edf tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:11.521765 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-6d8c4e56-79a6-4aab-8202-08e9bdda3edf tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:11.522195 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-6d8c4e56-79a6-4aab-8202-08e9bdda3edf tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:11.667034 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-6d8c4e56-79a6-4aab-8202-08e9bdda3edf tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:11.677461 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-6d8c4e56-79a6-4aab-8202-08e9bdda3edf tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:11.678998 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-6d8c4e56-79a6-4aab-8202-08e9bdda3edf tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:11.680643 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-6d8c4e56-79a6-4aab-8202-08e9bdda3edf tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1809 microversion: 2.20 time: 0.170752 Jun 07 14:45:11.681405 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 281/572] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:45:11 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:45:12.104316 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-633ae7b3-c8d4-43e4-92f4-3a6d66e95806 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:45:12.104968 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-633ae7b3-c8d4-43e4-92f4-3a6d66e95806 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 7dec201c-634b-4b93-bc30-0ac8e60795c7] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:45:12.112101 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-633ae7b3-c8d4-43e4-92f4-3a6d66e95806 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:12.112600 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-633ae7b3-c8d4-43e4-92f4-3a6d66e95806 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:12.113499 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-633ae7b3-c8d4-43e4-92f4-3a6d66e95806 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:12.113946 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-633ae7b3-c8d4-43e4-92f4-3a6d66e95806 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:12.282347 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-633ae7b3-c8d4-43e4-92f4-3a6d66e95806 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:12.290879 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-633ae7b3-c8d4-43e4-92f4-3a6d66e95806 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7" status: 200 len: 1734 microversion: 2.1 time: 0.190882 Jun 07 14:45:12.291758 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 292/573] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:45:12 2022] GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7 => generated 1734 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:45:12.699601 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-e600ec55-487a-4422-b7d3-cb3d98686c49 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:45:12.700170 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-e600ec55-487a-4422-b7d3-cb3d98686c49 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:45:12.706634 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-e600ec55-487a-4422-b7d3-cb3d98686c49 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:12.707092 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-e600ec55-487a-4422-b7d3-cb3d98686c49 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:12.707858 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-e600ec55-487a-4422-b7d3-cb3d98686c49 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:12.708280 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-e600ec55-487a-4422-b7d3-cb3d98686c49 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:12.835314 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-e600ec55-487a-4422-b7d3-cb3d98686c49 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:12.844332 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-e600ec55-487a-4422-b7d3-cb3d98686c49 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:12.845847 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-e600ec55-487a-4422-b7d3-cb3d98686c49 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:12.846994 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-e600ec55-487a-4422-b7d3-cb3d98686c49 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1809 microversion: 2.20 time: 0.151833 Jun 07 14:45:12.847540 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 282/574] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:45:12 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:45:13.308547 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-95e8c4db-7734-4a39-8a2e-e67546c9627e tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:45:13.309165 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-95e8c4db-7734-4a39-8a2e-e67546c9627e tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 7dec201c-634b-4b93-bc30-0ac8e60795c7] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:45:13.315564 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-95e8c4db-7734-4a39-8a2e-e67546c9627e tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:13.316017 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-95e8c4db-7734-4a39-8a2e-e67546c9627e tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:13.316829 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-95e8c4db-7734-4a39-8a2e-e67546c9627e tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:13.317270 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-95e8c4db-7734-4a39-8a2e-e67546c9627e tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:13.429432 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [req-ffc20631-6732-463c-8cba-6eb21488669a req-acf26be1-566c-432c-a625-77c4cb08bbd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8a8352c-4f05-4640-a976-edb025819089", "name": "network-vif-plugged", "status": "completed", "tag": "557a43fa-c7ca-47d0-9a4b-fe35626e8941"}]} {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:45:13.438141 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [req-ffc20631-6732-463c-8cba-6eb21488669a req-acf26be1-566c-432c-a625-77c4cb08bbd2 service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:13.438576 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [req-ffc20631-6732-463c-8cba-6eb21488669a req-acf26be1-566c-432c-a625-77c4cb08bbd2 service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:13.450482 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.compute.server_external_events [req-ffc20631-6732-463c-8cba-6eb21488669a req-acf26be1-566c-432c-a625-77c4cb08bbd2 service nova] Creating event network-vif-plugged:557a43fa-c7ca-47d0-9a4b-fe35626e8941 for instance a8a8352c-4f05-4640-a976-edb025819089 on hv-cinder-84497 Jun 07 14:45:13.455584 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [req-ffc20631-6732-463c-8cba-6eb21488669a req-acf26be1-566c-432c-a625-77c4cb08bbd2 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092482 Jun 07 14:45:13.456339 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 283/575] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jun 7 14:45:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 14:45:13.457979 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-95e8c4db-7734-4a39-8a2e-e67546c9627e tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:13.466424 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-95e8c4db-7734-4a39-8a2e-e67546c9627e tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7" status: 200 len: 1734 microversion: 2.1 time: 0.162291 Jun 07 14:45:13.467010 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 293/576] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:45:13 2022] GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7 => generated 1734 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:45:13.866532 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-edd332b2-baf0-402d-868f-bebf353e0c4e tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:45:13.867266 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-edd332b2-baf0-402d-868f-bebf353e0c4e tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:45:13.874355 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-edd332b2-baf0-402d-868f-bebf353e0c4e tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:13.874805 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-edd332b2-baf0-402d-868f-bebf353e0c4e tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:13.875576 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-edd332b2-baf0-402d-868f-bebf353e0c4e tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:13.876025 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-edd332b2-baf0-402d-868f-bebf353e0c4e tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:14.012762 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-edd332b2-baf0-402d-868f-bebf353e0c4e tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:14.021266 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-edd332b2-baf0-402d-868f-bebf353e0c4e tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:14.022777 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-edd332b2-baf0-402d-868f-bebf353e0c4e tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:14.023931 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-edd332b2-baf0-402d-868f-bebf353e0c4e tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1809 microversion: 2.20 time: 0.162236 Jun 07 14:45:14.024502 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 284/577] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:45:13 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:45:14.483873 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-313ecd6a-6d28-4102-b7ce-25fd6b0664ac tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:45:14.484600 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-313ecd6a-6d28-4102-b7ce-25fd6b0664ac tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 7dec201c-634b-4b93-bc30-0ac8e60795c7] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:45:14.491161 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-313ecd6a-6d28-4102-b7ce-25fd6b0664ac tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:14.491610 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-313ecd6a-6d28-4102-b7ce-25fd6b0664ac tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:14.493089 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-313ecd6a-6d28-4102-b7ce-25fd6b0664ac tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:14.493512 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-313ecd6a-6d28-4102-b7ce-25fd6b0664ac tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:14.631151 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-313ecd6a-6d28-4102-b7ce-25fd6b0664ac tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:14.639054 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-313ecd6a-6d28-4102-b7ce-25fd6b0664ac tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7" status: 200 len: 1734 microversion: 2.1 time: 0.159121 Jun 07 14:45:14.639618 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 294/578] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:45:14 2022] GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7 => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:45:15.041990 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-e4fc109f-bee7-4f5c-bff3-3e87fe1bae67 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:45:15.042537 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-e4fc109f-bee7-4f5c-bff3-3e87fe1bae67 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:45:15.049252 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-e4fc109f-bee7-4f5c-bff3-3e87fe1bae67 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:15.050401 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-e4fc109f-bee7-4f5c-bff3-3e87fe1bae67 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:15.050573 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-e4fc109f-bee7-4f5c-bff3-3e87fe1bae67 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:15.050871 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-e4fc109f-bee7-4f5c-bff3-3e87fe1bae67 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:15.180966 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-e4fc109f-bee7-4f5c-bff3-3e87fe1bae67 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:15.189193 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-e4fc109f-bee7-4f5c-bff3-3e87fe1bae67 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:15.190745 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-e4fc109f-bee7-4f5c-bff3-3e87fe1bae67 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:15.191870 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-e4fc109f-bee7-4f5c-bff3-3e87fe1bae67 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1809 microversion: 2.20 time: 0.153863 Jun 07 14:45:15.192427 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 285/579] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:45:15 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 14:45:15.340109 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-99d1016b-7101-4d85-b710-932888d0ad3b tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:45:15.340689 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-99d1016b-7101-4d85-b710-932888d0ad3b tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] [instance: a185db4f-620b-4359-a1ad-7f4efba9c869] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:45:15.346812 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-99d1016b-7101-4d85-b710-932888d0ad3b tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:15.347262 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-99d1016b-7101-4d85-b710-932888d0ad3b tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:15.348026 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-99d1016b-7101-4d85-b710-932888d0ad3b tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:15.348493 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-99d1016b-7101-4d85-b710-932888d0ad3b tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:15.366342 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG dbcounter [-] [118158] Writing DB stats nova_cell1:SELECT=100 {{(pid=118158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:45:15.428904 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.objects.instance [None req-99d1016b-7101-4d85-b710-932888d0ad3b tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lazy-loading 'services' on Instance uuid a185db4f-620b-4359-a1ad-7f4efba9c869 {{(pid=118158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 14:45:15.640446 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-99d1016b-7101-4d85-b710-932888d0ad3b tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] 10.222.0.85 "DELETE /compute/v2.1/servers/a185db4f-620b-4359-a1ad-7f4efba9c869/os-volume_attachments/13104e74-0abc-49f7-a1ef-a82e33b381e2" status: 202 len: 0 microversion: 2.1 time: 0.304253 Jun 07 14:45:15.641037 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 295/580] 10.222.0.85 () {58 vars in 1415 bytes} [Tue Jun 7 14:45:15 2022] DELETE /compute/v2.1/servers/a185db4f-620b-4359-a1ad-7f4efba9c869/os-volume_attachments/13104e74-0abc-49f7-a1ef-a82e33b381e2 => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 14:45:15.649887 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-dac10b8f-91fa-4fb1-ac78-633f5e909906 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:45:15.656127 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-dac10b8f-91fa-4fb1-ac78-633f5e909906 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:15.656613 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-dac10b8f-91fa-4fb1-ac78-633f5e909906 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:15.659348 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-7e22cd44-661e-40a0-b555-676a28759c1c tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:45:15.660110 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-7e22cd44-661e-40a0-b555-676a28759c1c tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 7dec201c-634b-4b93-bc30-0ac8e60795c7] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:45:15.666627 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-7e22cd44-661e-40a0-b555-676a28759c1c tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:15.667168 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-7e22cd44-661e-40a0-b555-676a28759c1c tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:15.668004 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-7e22cd44-661e-40a0-b555-676a28759c1c tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:15.668649 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-7e22cd44-661e-40a0-b555-676a28759c1c tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:15.718434 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-dac10b8f-91fa-4fb1-ac78-633f5e909906 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6] Going to try to stop instance {{(pid=118157) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 07 14:45:15.811230 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG dbcounter [-] [118157] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:45:15.813008 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-7e22cd44-661e-40a0-b555-676a28759c1c tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:15.833332 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-7e22cd44-661e-40a0-b555-676a28759c1c tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7" status: 200 len: 1714 microversion: 2.1 time: 0.180014 Jun 07 14:45:15.833914 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 296/581] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:45:15 2022] GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7 => generated 1714 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:45:15.892638 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-8cf63d8b-b51f-4677-8bcc-86ba980dcbcc tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:45:15.893138 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-8cf63d8b-b51f-4677-8bcc-86ba980dcbcc tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 7dec201c-634b-4b93-bc30-0ac8e60795c7] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:45:15.899622 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-8cf63d8b-b51f-4677-8bcc-86ba980dcbcc tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:15.900975 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-8cf63d8b-b51f-4677-8bcc-86ba980dcbcc tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:15.900975 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-8cf63d8b-b51f-4677-8bcc-86ba980dcbcc tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:15.901392 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-8cf63d8b-b51f-4677-8bcc-86ba980dcbcc tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:15.927218 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-dac10b8f-91fa-4fb1-ac78-633f5e909906 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "POST /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6/action" status: 202 len: 0 microversion: 2.1 time: 0.281281 Jun 07 14:45:15.927820 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 286/582] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Jun 7 14:45:15 2022] POST /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6/action => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 14:45:15.938919 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-155b5889-493e-4f9a-81c1-589a51a1bb08 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:45:15.939870 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-155b5889-493e-4f9a-81c1-589a51a1bb08 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:45:15.949670 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-155b5889-493e-4f9a-81c1-589a51a1bb08 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:15.950268 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-155b5889-493e-4f9a-81c1-589a51a1bb08 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:15.951533 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-155b5889-493e-4f9a-81c1-589a51a1bb08 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:15.952207 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-155b5889-493e-4f9a-81c1-589a51a1bb08 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:15.992286 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.wsgi [None req-8cf63d8b-b51f-4677-8bcc-86ba980dcbcc tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] HTTP exception thrown: Cannot 'detach_volume' instance 7dec201c-634b-4b93-bc30-0ac8e60795c7 while it is in vm_state rescued Jun 07 14:45:15.994808 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-8cf63d8b-b51f-4677-8bcc-86ba980dcbcc tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Request method failure captured: Jun 07 14:45:15.994808 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: request: DELETE /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7/os-volume_attachments/a64e513d-aa73-4193-b8d4-e946bc9063ac HTTP/1.1 Jun 07 14:45:15.994808 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Accept: application/json Jun 07 14:45:15.994808 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Accept-Encoding: identity Jun 07 14:45:15.994808 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Connection: close Jun 07 14:45:15.994808 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Content-Length: 0 Jun 07 14:45:15.994808 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Content-Type: application/json Jun 07 14:45:15.994808 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Host: 10.222.0.85 Jun 07 14:45:15.994808 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Openstack-System-Scope: None Jun 07 14:45:15.994808 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: User-Agent: python-urllib3/1.26.9 Jun 07 14:45:15.994808 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Auth-Token: gAAAAABin2MfoYDVhu2np0DRcQVNUXdKMfJ65XCHwNNgDzofb7UJB-BWXWBLWaEswfOjFb54DUFMtQxlwkMGgXmEQLjfj_mQyFqyWAiCHR0I3nl7bqHSoOmAgQ9B8P9sCJ5_1DmOjuYjvvS65ktGlA1sVBmQ3mMGWuAH2ULxrW_BKmx6e7vrexU Jun 07 14:45:15.994808 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Domain-Id: None Jun 07 14:45:15.994808 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Domain-Name: None Jun 07 14:45:15.994808 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Identity-Status: Confirmed Jun 07 14:45:15.994808 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Is-Admin-Project: True Jun 07 14:45:15.994808 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Domain-Id: default Jun 07 14:45:15.994808 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Domain-Name: Default Jun 07 14:45:15.994808 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Id: e80aa19d008640df9a1f924a7c03f7f6 Jun 07 14:45:15.994808 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1172669914 Jun 07 14:45:15.994808 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Role: member,reader Jun 07 14:45:15.994808 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Roles: member,reader Jun 07 14:45:15.996319 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e80aa19d008640df9a1f924a7c03f7f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_e80aa19d008640df9a1f924a7c03f7f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e80aa19d008640df9a1f924a7c03f7f6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/e80aa19d008640df9a1f924a7c03f7f6"}]}] Jun 07 14:45:15.996319 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1172669914 Jun 07 14:45:15.996319 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Tenant-Id: e80aa19d008640df9a1f924a7c03f7f6 Jun 07 14:45:15.996319 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1172669914 Jun 07 14:45:15.996319 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User: tempest-ServerRescueNegativeTestJSON-1172669914-project Jun 07 14:45:15.996319 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Domain-Id: default Jun 07 14:45:15.996319 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Domain-Name: Default Jun 07 14:45:15.996319 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Id: 48bbf88b32774d5da9ef93ac75686c34 Jun 07 14:45:15.996319 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1172669914-project Jun 07 14:45:15.996319 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: method: > Jun 07 14:45:15.996319 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: exception: Cannot 'detach_volume' instance 7dec201c-634b-4b93-bc30-0ac8e60795c7 while it is in vm_state rescued Jun 07 14:45:15.997127 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: action_args: {'server_id': '7dec201c-634b-4b93-bc30-0ac8e60795c7', 'id': 'a64e513d-aa73-4193-b8d4-e946bc9063ac'} Jun 07 14:45:15.997127 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:45:15.997127 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:45:15.997127 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 07 14:45:15.997127 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 07 14:45:15.997127 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 07 14:45:15.997127 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 07 14:45:15.997127 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 07 14:45:15.997127 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 07 14:45:15.997127 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7dec201c-634b-4b93-bc30-0ac8e60795c7 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 07 14:45:15.997127 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:45:15.997127 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:45:15.997127 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:45:15.997127 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:45:15.997127 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:45:15.997127 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:45:15.997127 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:45:15.997127 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:45:15.997127 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:45:15.997127 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:45:15.999145 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 07 14:45:15.999145 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 07 14:45:15.999145 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 07 14:45:15.999145 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 07 14:45:15.999145 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 7dec201c-634b-4b93-bc30-0ac8e60795c7 while it is in vm_state rescued Jun 07 14:45:15.999145 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:45:15.999145 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:45:15.999145 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:45:15.999145 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:45:15.999145 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:45:15.999145 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:45:15.999145 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:45:15.999145 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:45:15.999145 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 7dec201c-634b-4b93-bc30-0ac8e60795c7 while it is in vm_state rescued Jun 07 14:45:15.999145 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:45:16.002553 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-8cf63d8b-b51f-4677-8bcc-86ba980dcbcc tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Returning 409 to user: Cannot 'detach_volume' instance 7dec201c-634b-4b93-bc30-0ac8e60795c7 while it is in vm_state rescued {{(pid=118158) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:45:16.004352 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-8cf63d8b-b51f-4677-8bcc-86ba980dcbcc tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "DELETE /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7/os-volume_attachments/a64e513d-aa73-4193-b8d4-e946bc9063ac" status: 409 len: 152 microversion: 2.1 time: 0.115723 Jun 07 14:45:16.006039 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 297/583] 10.222.0.85 () {58 vars in 1415 bytes} [Tue Jun 7 14:45:15 2022] DELETE /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7/os-volume_attachments/a64e513d-aa73-4193-b8d4-e946bc9063ac => generated 152 bytes in 118 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jun 07 14:45:16.016931 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-96866242-9ead-407a-b2dc-1642711fc7ca tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:45:16.017488 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-96866242-9ead-407a-b2dc-1642711fc7ca tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 7dec201c-634b-4b93-bc30-0ac8e60795c7] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:45:16.025614 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-96866242-9ead-407a-b2dc-1642711fc7ca tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:16.025614 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-96866242-9ead-407a-b2dc-1642711fc7ca tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:16.025614 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-96866242-9ead-407a-b2dc-1642711fc7ca tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:16.025997 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-96866242-9ead-407a-b2dc-1642711fc7ca tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:16.112985 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-155b5889-493e-4f9a-81c1-589a51a1bb08 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb4b0cf5f8b4274b787f327793964f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ba26b86c7243dab8e6c6b84ed674e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:16.120454 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-155b5889-493e-4f9a-81c1-589a51a1bb08 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6" status: 200 len: 1679 microversion: 2.1 time: 0.186922 Jun 07 14:45:16.121009 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 287/584] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:45:15 2022] GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 => generated 1679 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:45:16.210654 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-fbecefd6-baed-43ad-8137-f439f3c06bfd tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:45:16.211827 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-fbecefd6-baed-43ad-8137-f439f3c06bfd tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:45:16.217927 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-fbecefd6-baed-43ad-8137-f439f3c06bfd tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:16.218382 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-fbecefd6-baed-43ad-8137-f439f3c06bfd tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:16.219153 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-fbecefd6-baed-43ad-8137-f439f3c06bfd tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:16.219590 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-fbecefd6-baed-43ad-8137-f439f3c06bfd tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:16.258107 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-96866242-9ead-407a-b2dc-1642711fc7ca tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "POST /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7/action" status: 202 len: 0 microversion: 2.1 time: 0.247195 Jun 07 14:45:16.258895 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 298/585] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Jun 7 14:45:16 2022] POST /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7/action => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 14:45:16.267569 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-b90951f2-6055-4359-8004-ff785c620be0 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:45:16.270489 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-b90951f2-6055-4359-8004-ff785c620be0 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 7dec201c-634b-4b93-bc30-0ac8e60795c7] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:45:16.275743 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-b90951f2-6055-4359-8004-ff785c620be0 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:16.276200 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-b90951f2-6055-4359-8004-ff785c620be0 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:16.277026 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-b90951f2-6055-4359-8004-ff785c620be0 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:16.277463 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-b90951f2-6055-4359-8004-ff785c620be0 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:16.356620 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-fbecefd6-baed-43ad-8137-f439f3c06bfd tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:16.365610 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-fbecefd6-baed-43ad-8137-f439f3c06bfd tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:16.367014 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-fbecefd6-baed-43ad-8137-f439f3c06bfd tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:16.368274 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-fbecefd6-baed-43ad-8137-f439f3c06bfd tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1809 microversion: 2.20 time: 0.161414 Jun 07 14:45:16.368871 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 288/586] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:45:16 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 14:45:16.424707 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-b90951f2-6055-4359-8004-ff785c620be0 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:16.432595 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-b90951f2-6055-4359-8004-ff785c620be0 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7" status: 200 len: 1722 microversion: 2.1 time: 0.169389 Jun 07 14:45:16.433146 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 299/587] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:45:16 2022] GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:45:17.142825 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-38dea2b4-fcc4-48af-ae8d-ce7c19829987 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:45:17.143432 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-38dea2b4-fcc4-48af-ae8d-ce7c19829987 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:45:17.150302 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-38dea2b4-fcc4-48af-ae8d-ce7c19829987 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:17.150751 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-38dea2b4-fcc4-48af-ae8d-ce7c19829987 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:17.151523 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-38dea2b4-fcc4-48af-ae8d-ce7c19829987 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:17.151958 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-38dea2b4-fcc4-48af-ae8d-ce7c19829987 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:17.281962 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-38dea2b4-fcc4-48af-ae8d-ce7c19829987 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb4b0cf5f8b4274b787f327793964f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ba26b86c7243dab8e6c6b84ed674e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:17.290044 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-38dea2b4-fcc4-48af-ae8d-ce7c19829987 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6" status: 200 len: 1679 microversion: 2.1 time: 0.150679 Jun 07 14:45:17.290602 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 289/588] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:45:17 2022] GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:45:17.387921 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-e5fa1fb6-93b0-4499-a621-d9539e8087ae tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:45:17.388565 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-e5fa1fb6-93b0-4499-a621-d9539e8087ae tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:45:17.394981 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-e5fa1fb6-93b0-4499-a621-d9539e8087ae tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:17.395427 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-e5fa1fb6-93b0-4499-a621-d9539e8087ae tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:17.396214 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-e5fa1fb6-93b0-4499-a621-d9539e8087ae tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:17.396679 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-e5fa1fb6-93b0-4499-a621-d9539e8087ae tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:17.449789 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-3d1f22d9-1695-47e1-9041-b00e6f837bf2 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:45:17.450392 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-3d1f22d9-1695-47e1-9041-b00e6f837bf2 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 7dec201c-634b-4b93-bc30-0ac8e60795c7] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:45:17.456277 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-3d1f22d9-1695-47e1-9041-b00e6f837bf2 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:17.456763 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-3d1f22d9-1695-47e1-9041-b00e6f837bf2 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:17.457523 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-3d1f22d9-1695-47e1-9041-b00e6f837bf2 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:17.457955 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-3d1f22d9-1695-47e1-9041-b00e6f837bf2 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:17.532220 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-e5fa1fb6-93b0-4499-a621-d9539e8087ae tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:17.542488 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-e5fa1fb6-93b0-4499-a621-d9539e8087ae tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:17.543987 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-e5fa1fb6-93b0-4499-a621-d9539e8087ae tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:17.545692 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-e5fa1fb6-93b0-4499-a621-d9539e8087ae tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1809 microversion: 2.20 time: 0.161885 Jun 07 14:45:17.546436 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 300/589] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:45:17 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:45:17.592662 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-3d1f22d9-1695-47e1-9041-b00e6f837bf2 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:17.598380 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-3d1f22d9-1695-47e1-9041-b00e6f837bf2 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7" status: 200 len: 1722 microversion: 2.1 time: 0.152369 Jun 07 14:45:17.598935 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 290/590] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:45:17 2022] GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:45:18.307916 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-21ed4d5d-946d-4ced-9495-8329dfbc3aa4 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:45:18.308681 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-21ed4d5d-946d-4ced-9495-8329dfbc3aa4 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:45:18.314627 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-21ed4d5d-946d-4ced-9495-8329dfbc3aa4 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:18.315076 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-21ed4d5d-946d-4ced-9495-8329dfbc3aa4 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:18.315837 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-21ed4d5d-946d-4ced-9495-8329dfbc3aa4 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:18.316276 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-21ed4d5d-946d-4ced-9495-8329dfbc3aa4 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:18.502832 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-21ed4d5d-946d-4ced-9495-8329dfbc3aa4 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb4b0cf5f8b4274b787f327793964f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ba26b86c7243dab8e6c6b84ed674e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:18.511237 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-21ed4d5d-946d-4ced-9495-8329dfbc3aa4 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6" status: 200 len: 1679 microversion: 2.1 time: 0.207679 Jun 07 14:45:18.511806 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 301/591] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:45:18 2022] GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 => generated 1679 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:45:18.565039 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-bfec707e-b51b-4726-b736-ccdab7ad8840 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:45:18.565653 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-bfec707e-b51b-4726-b736-ccdab7ad8840 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:45:18.572942 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-bfec707e-b51b-4726-b736-ccdab7ad8840 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:18.573394 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-bfec707e-b51b-4726-b736-ccdab7ad8840 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:18.574159 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-bfec707e-b51b-4726-b736-ccdab7ad8840 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:18.574599 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-bfec707e-b51b-4726-b736-ccdab7ad8840 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:18.617831 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-36793764-8366-4897-92af-2eec647036f1 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:45:18.618711 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-36793764-8366-4897-92af-2eec647036f1 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 7dec201c-634b-4b93-bc30-0ac8e60795c7] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:45:18.624921 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-36793764-8366-4897-92af-2eec647036f1 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:18.625568 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-36793764-8366-4897-92af-2eec647036f1 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:18.626352 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-36793764-8366-4897-92af-2eec647036f1 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:18.626801 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-36793764-8366-4897-92af-2eec647036f1 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:18.723853 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-bfec707e-b51b-4726-b736-ccdab7ad8840 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:18.749493 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-bfec707e-b51b-4726-b736-ccdab7ad8840 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:18.751135 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-bfec707e-b51b-4726-b736-ccdab7ad8840 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:18.752560 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-bfec707e-b51b-4726-b736-ccdab7ad8840 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1809 microversion: 2.20 time: 0.191401 Jun 07 14:45:18.753103 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 291/592] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:45:18 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1809 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:45:18.816945 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-36793764-8366-4897-92af-2eec647036f1 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:18.826143 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-36793764-8366-4897-92af-2eec647036f1 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7" status: 200 len: 1722 microversion: 2.1 time: 0.213701 Jun 07 14:45:18.826712 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 302/593] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:45:18 2022] GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7 => generated 1722 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:45:19.532305 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-7ff8f144-fcc6-49d4-b44e-999e735d62bd tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:45:19.532305 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-7ff8f144-fcc6-49d4-b44e-999e735d62bd tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:45:19.537753 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-7ff8f144-fcc6-49d4-b44e-999e735d62bd tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:19.538271 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-7ff8f144-fcc6-49d4-b44e-999e735d62bd tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:19.539089 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-7ff8f144-fcc6-49d4-b44e-999e735d62bd tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:19.539530 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-7ff8f144-fcc6-49d4-b44e-999e735d62bd tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:19.684596 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-7ff8f144-fcc6-49d4-b44e-999e735d62bd tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb4b0cf5f8b4274b787f327793964f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ba26b86c7243dab8e6c6b84ed674e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:19.693386 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-7ff8f144-fcc6-49d4-b44e-999e735d62bd tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6" status: 200 len: 1679 microversion: 2.1 time: 0.167011 Jun 07 14:45:19.693993 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 292/594] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:45:19 2022] GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 => generated 1679 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:45:19.771833 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-225eee3e-6ec0-4679-9047-846afb85b6f2 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:45:19.774053 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-225eee3e-6ec0-4679-9047-846afb85b6f2 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:45:19.781507 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-225eee3e-6ec0-4679-9047-846afb85b6f2 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:19.781951 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-225eee3e-6ec0-4679-9047-846afb85b6f2 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:19.782718 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-225eee3e-6ec0-4679-9047-846afb85b6f2 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:19.783152 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-225eee3e-6ec0-4679-9047-846afb85b6f2 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:19.843461 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-09182e28-2efa-4861-8191-269ffab03f52 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:45:19.844069 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-09182e28-2efa-4861-8191-269ffab03f52 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 7dec201c-634b-4b93-bc30-0ac8e60795c7] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:45:19.850206 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-09182e28-2efa-4861-8191-269ffab03f52 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:19.850651 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-09182e28-2efa-4861-8191-269ffab03f52 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:19.851412 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-09182e28-2efa-4861-8191-269ffab03f52 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:19.851840 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-09182e28-2efa-4861-8191-269ffab03f52 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:20.014332 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-225eee3e-6ec0-4679-9047-846afb85b6f2 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:20.015357 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-09182e28-2efa-4861-8191-269ffab03f52 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:20.025150 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-09182e28-2efa-4861-8191-269ffab03f52 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7" status: 200 len: 1722 microversion: 2.1 time: 0.185222 Jun 07 14:45:20.026475 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 293/595] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:45:19 2022] GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7 => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:45:20.032355 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-585db473-d262-4c71-97af-f9f0d671dded tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:45:20.032990 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-585db473-d262-4c71-97af-f9f0d671dded tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] [instance: a185db4f-620b-4359-a1ad-7f4efba9c869] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:45:20.039579 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-585db473-d262-4c71-97af-f9f0d671dded tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:20.050582 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-585db473-d262-4c71-97af-f9f0d671dded tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:20.050831 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-225eee3e-6ec0-4679-9047-846afb85b6f2 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:20.051017 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-585db473-d262-4c71-97af-f9f0d671dded tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:20.051017 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-585db473-d262-4c71-97af-f9f0d671dded tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:20.051298 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-225eee3e-6ec0-4679-9047-846afb85b6f2 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:20.051298 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-225eee3e-6ec0-4679-9047-846afb85b6f2 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1809 microversion: 2.20 time: 0.276952 Jun 07 14:45:20.051298 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 303/596] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:45:19 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1809 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:45:20.073312 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-585db473-d262-4c71-97af-f9f0d671dded tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] [instance: a185db4f-620b-4359-a1ad-7f4efba9c869] Going to try to terminate instance {{(pid=118157) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 14:45:20.289297 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-585db473-d262-4c71-97af-f9f0d671dded tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] 10.222.0.85 "DELETE /compute/v2.1/servers/a185db4f-620b-4359-a1ad-7f4efba9c869" status: 204 len: 0 microversion: 2.1 time: 0.261392 Jun 07 14:45:20.289872 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 294/597] 10.222.0.85 () {58 vars in 1238 bytes} [Tue Jun 7 14:45:20 2022] DELETE /compute/v2.1/servers/a185db4f-620b-4359-a1ad-7f4efba9c869 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 14:45:20.297913 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-6249c534-bc2f-42d0-93d4-2fb5de66b627 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:45:20.301863 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-6249c534-bc2f-42d0-93d4-2fb5de66b627 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] [instance: a185db4f-620b-4359-a1ad-7f4efba9c869] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:45:20.304876 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-6249c534-bc2f-42d0-93d4-2fb5de66b627 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:20.305403 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-6249c534-bc2f-42d0-93d4-2fb5de66b627 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:20.306281 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-6249c534-bc2f-42d0-93d4-2fb5de66b627 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:20.306868 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-6249c534-bc2f-42d0-93d4-2fb5de66b627 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:20.443456 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-6249c534-bc2f-42d0-93d4-2fb5de66b627 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a605008cb5474f168f572fd0a9e71193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634574e706ee4f31bf4446871f11d5e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:20.451003 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-6249c534-bc2f-42d0-93d4-2fb5de66b627 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] 10.222.0.85 "GET /compute/v2.1/servers/a185db4f-620b-4359-a1ad-7f4efba9c869" status: 200 len: 1513 microversion: 2.1 time: 0.156913 Jun 07 14:45:20.451562 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 304/598] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:45:20 2022] GET /compute/v2.1/servers/a185db4f-620b-4359-a1ad-7f4efba9c869 => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:45:20.711253 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-ec0ee773-b8fd-4e3f-9daf-13edeac65e99 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:45:20.713823 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-ec0ee773-b8fd-4e3f-9daf-13edeac65e99 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:45:20.720004 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-ec0ee773-b8fd-4e3f-9daf-13edeac65e99 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:20.720513 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-ec0ee773-b8fd-4e3f-9daf-13edeac65e99 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:20.721342 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-ec0ee773-b8fd-4e3f-9daf-13edeac65e99 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:20.721783 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-ec0ee773-b8fd-4e3f-9daf-13edeac65e99 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:21.043051 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-3d19a6d0-4c68-4eae-87ac-a8d3a07c139c tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:45:21.043575 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-3d19a6d0-4c68-4eae-87ac-a8d3a07c139c tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 7dec201c-634b-4b93-bc30-0ac8e60795c7] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:45:21.050258 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-3d19a6d0-4c68-4eae-87ac-a8d3a07c139c tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:21.050717 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-3d19a6d0-4c68-4eae-87ac-a8d3a07c139c tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:21.051501 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-3d19a6d0-4c68-4eae-87ac-a8d3a07c139c tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:21.051943 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-3d19a6d0-4c68-4eae-87ac-a8d3a07c139c tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:21.072440 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-ec0ee773-b8fd-4e3f-9daf-13edeac65e99 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb4b0cf5f8b4274b787f327793964f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ba26b86c7243dab8e6c6b84ed674e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:21.080668 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-ec0ee773-b8fd-4e3f-9daf-13edeac65e99 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6" status: 200 len: 1679 microversion: 2.1 time: 0.373138 Jun 07 14:45:21.080668 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 295/599] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:45:20 2022] GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 => generated 1679 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:45:21.094166 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-4b3e2e57-c6a7-48d3-8883-c6123f5968c2 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:45:21.094779 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-4b3e2e57-c6a7-48d3-8883-c6123f5968c2 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:45:21.101001 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-4b3e2e57-c6a7-48d3-8883-c6123f5968c2 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:21.101447 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-4b3e2e57-c6a7-48d3-8883-c6123f5968c2 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:21.102220 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-4b3e2e57-c6a7-48d3-8883-c6123f5968c2 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:21.102660 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-4b3e2e57-c6a7-48d3-8883-c6123f5968c2 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:21.186569 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-3d19a6d0-4c68-4eae-87ac-a8d3a07c139c tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:21.194431 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-3d19a6d0-4c68-4eae-87ac-a8d3a07c139c tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7" status: 200 len: 1722 microversion: 2.1 time: 0.155365 Jun 07 14:45:21.194985 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 305/600] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:45:21 2022] GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:45:21.230302 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-4b3e2e57-c6a7-48d3-8883-c6123f5968c2 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:21.238680 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-4b3e2e57-c6a7-48d3-8883-c6123f5968c2 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:21.240171 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-4b3e2e57-c6a7-48d3-8883-c6123f5968c2 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:21.241375 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-4b3e2e57-c6a7-48d3-8883-c6123f5968c2 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1809 microversion: 2.20 time: 0.159704 Jun 07 14:45:21.241920 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 296/601] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:45:21 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:45:21.468803 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-a158504e-6bc8-4c29-bc19-8fe16e1541f6 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:45:21.469441 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-a158504e-6bc8-4c29-bc19-8fe16e1541f6 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] [instance: a185db4f-620b-4359-a1ad-7f4efba9c869] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:45:21.475318 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-a158504e-6bc8-4c29-bc19-8fe16e1541f6 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:21.475762 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-a158504e-6bc8-4c29-bc19-8fe16e1541f6 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:21.476537 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-a158504e-6bc8-4c29-bc19-8fe16e1541f6 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:21.476968 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-a158504e-6bc8-4c29-bc19-8fe16e1541f6 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:21.601147 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-a158504e-6bc8-4c29-bc19-8fe16e1541f6 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a605008cb5474f168f572fd0a9e71193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634574e706ee4f31bf4446871f11d5e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:21.609772 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-a158504e-6bc8-4c29-bc19-8fe16e1541f6 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] 10.222.0.85 "GET /compute/v2.1/servers/a185db4f-620b-4359-a1ad-7f4efba9c869" status: 200 len: 1513 microversion: 2.1 time: 0.144821 Jun 07 14:45:21.610335 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 306/602] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:45:21 2022] GET /compute/v2.1/servers/a185db4f-620b-4359-a1ad-7f4efba9c869 => generated 1513 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:45:22.098150 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-1a2fd5be-6aec-4a48-905c-8e39f2685caf tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:45:22.098714 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-1a2fd5be-6aec-4a48-905c-8e39f2685caf tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:45:22.105339 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-1a2fd5be-6aec-4a48-905c-8e39f2685caf tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:22.105788 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-1a2fd5be-6aec-4a48-905c-8e39f2685caf tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:22.106550 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-1a2fd5be-6aec-4a48-905c-8e39f2685caf tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:22.106980 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-1a2fd5be-6aec-4a48-905c-8e39f2685caf tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:22.210825 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-ec8f055e-e0fa-4253-94c1-f28904a90df2 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:45:22.212049 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-ec8f055e-e0fa-4253-94c1-f28904a90df2 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 7dec201c-634b-4b93-bc30-0ac8e60795c7] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:45:22.219720 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-ec8f055e-e0fa-4253-94c1-f28904a90df2 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:22.220174 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-ec8f055e-e0fa-4253-94c1-f28904a90df2 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:22.220989 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-ec8f055e-e0fa-4253-94c1-f28904a90df2 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:22.221427 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-ec8f055e-e0fa-4253-94c1-f28904a90df2 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:22.238842 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-1a2fd5be-6aec-4a48-905c-8e39f2685caf tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb4b0cf5f8b4274b787f327793964f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ba26b86c7243dab8e6c6b84ed674e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:22.247003 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-1a2fd5be-6aec-4a48-905c-8e39f2685caf tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6" status: 200 len: 1679 microversion: 2.1 time: 0.152706 Jun 07 14:45:22.247714 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 297/603] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:45:22 2022] GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:45:22.259728 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-c95ba395-8e8d-44e9-8ebd-cebbb772e95b tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:45:22.260525 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-c95ba395-8e8d-44e9-8ebd-cebbb772e95b tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:45:22.267120 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-c95ba395-8e8d-44e9-8ebd-cebbb772e95b tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:22.267566 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-c95ba395-8e8d-44e9-8ebd-cebbb772e95b tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:22.268338 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-c95ba395-8e8d-44e9-8ebd-cebbb772e95b tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:22.268777 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-c95ba395-8e8d-44e9-8ebd-cebbb772e95b tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:22.419448 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-ec8f055e-e0fa-4253-94c1-f28904a90df2 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:22.423901 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-c95ba395-8e8d-44e9-8ebd-cebbb772e95b tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:22.430061 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-ec8f055e-e0fa-4253-94c1-f28904a90df2 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7" status: 200 len: 1722 microversion: 2.1 time: 0.222929 Jun 07 14:45:22.432405 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-c95ba395-8e8d-44e9-8ebd-cebbb772e95b tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:22.434480 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 307/604] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:45:22 2022] GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7 => generated 1722 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:45:22.435044 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-c95ba395-8e8d-44e9-8ebd-cebbb772e95b tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:22.436143 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-c95ba395-8e8d-44e9-8ebd-cebbb772e95b tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1809 microversion: 2.20 time: 0.181131 Jun 07 14:45:22.438289 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 298/605] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:45:22 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1809 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 14:45:22.627411 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-eab139a4-39a3-4ba4-8606-d093c149326d tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:45:22.627935 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-eab139a4-39a3-4ba4-8606-d093c149326d tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] [instance: a185db4f-620b-4359-a1ad-7f4efba9c869] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:45:22.633960 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-eab139a4-39a3-4ba4-8606-d093c149326d tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:22.634629 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-eab139a4-39a3-4ba4-8606-d093c149326d tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:22.635788 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-eab139a4-39a3-4ba4-8606-d093c149326d tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:22.636227 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-eab139a4-39a3-4ba4-8606-d093c149326d tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:22.781526 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-eab139a4-39a3-4ba4-8606-d093c149326d tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a605008cb5474f168f572fd0a9e71193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634574e706ee4f31bf4446871f11d5e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:22.789093 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-eab139a4-39a3-4ba4-8606-d093c149326d tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] 10.222.0.85 "GET /compute/v2.1/servers/a185db4f-620b-4359-a1ad-7f4efba9c869" status: 200 len: 1513 microversion: 2.1 time: 0.165658 Jun 07 14:45:22.789684 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 308/606] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:45:22 2022] GET /compute/v2.1/servers/a185db4f-620b-4359-a1ad-7f4efba9c869 => generated 1513 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:45:23.264322 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-ad2f6467-8d0e-4475-b3bf-e0339e1c65b3 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:45:23.265039 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-ad2f6467-8d0e-4475-b3bf-e0339e1c65b3 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:45:23.272158 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-ad2f6467-8d0e-4475-b3bf-e0339e1c65b3 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:23.272641 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-ad2f6467-8d0e-4475-b3bf-e0339e1c65b3 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:23.273416 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-ad2f6467-8d0e-4475-b3bf-e0339e1c65b3 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:23.273848 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-ad2f6467-8d0e-4475-b3bf-e0339e1c65b3 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:23.411958 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-ad2f6467-8d0e-4475-b3bf-e0339e1c65b3 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb4b0cf5f8b4274b787f327793964f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ba26b86c7243dab8e6c6b84ed674e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:23.419915 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-ad2f6467-8d0e-4475-b3bf-e0339e1c65b3 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6" status: 200 len: 1679 microversion: 2.1 time: 0.159601 Jun 07 14:45:23.420487 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 299/607] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:45:23 2022] GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:45:23.455047 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-1be0086d-c425-439b-adbf-7041e40ab89a tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:45:23.455291 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-3153fe70-fcc2-440f-9322-0559ee8fc813 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:45:23.455792 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-1be0086d-c425-439b-adbf-7041e40ab89a tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 7dec201c-634b-4b93-bc30-0ac8e60795c7] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:45:23.455950 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-3153fe70-fcc2-440f-9322-0559ee8fc813 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:45:23.461742 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-1be0086d-c425-439b-adbf-7041e40ab89a tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:23.464631 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-1be0086d-c425-439b-adbf-7041e40ab89a tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:23.464766 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-3153fe70-fcc2-440f-9322-0559ee8fc813 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:23.464766 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-3153fe70-fcc2-440f-9322-0559ee8fc813 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:23.464947 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-1be0086d-c425-439b-adbf-7041e40ab89a tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:23.464947 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-1be0086d-c425-439b-adbf-7041e40ab89a tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:23.465129 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-3153fe70-fcc2-440f-9322-0559ee8fc813 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:23.465129 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-3153fe70-fcc2-440f-9322-0559ee8fc813 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:23.602072 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-1be0086d-c425-439b-adbf-7041e40ab89a tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:23.604056 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-3153fe70-fcc2-440f-9322-0559ee8fc813 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:23.610895 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-1be0086d-c425-439b-adbf-7041e40ab89a tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7" status: 200 len: 1722 microversion: 2.1 time: 0.159484 Jun 07 14:45:23.611461 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 300/608] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:45:23 2022] GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:45:23.612508 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-3153fe70-fcc2-440f-9322-0559ee8fc813 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:23.614022 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-3153fe70-fcc2-440f-9322-0559ee8fc813 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:23.615188 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-3153fe70-fcc2-440f-9322-0559ee8fc813 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1796 microversion: 2.20 time: 0.163819 Jun 07 14:45:23.615727 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 309/609] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:45:23 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1796 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:45:23.807126 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-0bec54a9-78d7-49bc-bf5e-b375a9a2f26f tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:45:23.807647 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-0bec54a9-78d7-49bc-bf5e-b375a9a2f26f tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] [instance: a185db4f-620b-4359-a1ad-7f4efba9c869] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:45:23.813929 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-0bec54a9-78d7-49bc-bf5e-b375a9a2f26f tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:23.814381 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-0bec54a9-78d7-49bc-bf5e-b375a9a2f26f tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:23.815141 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-0bec54a9-78d7-49bc-bf5e-b375a9a2f26f tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:23.815570 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-0bec54a9-78d7-49bc-bf5e-b375a9a2f26f tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:23.955689 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-0bec54a9-78d7-49bc-bf5e-b375a9a2f26f tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a605008cb5474f168f572fd0a9e71193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634574e706ee4f31bf4446871f11d5e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:23.959298 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG dbcounter [-] [118157] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:45:23.964415 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-0bec54a9-78d7-49bc-bf5e-b375a9a2f26f tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] 10.222.0.85 "GET /compute/v2.1/servers/a185db4f-620b-4359-a1ad-7f4efba9c869" status: 200 len: 1513 microversion: 2.1 time: 0.161685 Jun 07 14:45:23.965207 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 301/610] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:45:23 2022] GET /compute/v2.1/servers/a185db4f-620b-4359-a1ad-7f4efba9c869 => generated 1513 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:45:24.443266 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-0ba58375-cb70-494b-bf04-3d43411bf390 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:45:24.443880 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-0ba58375-cb70-494b-bf04-3d43411bf390 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:45:24.450718 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-0ba58375-cb70-494b-bf04-3d43411bf390 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:24.451167 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-0ba58375-cb70-494b-bf04-3d43411bf390 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:24.451934 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-0ba58375-cb70-494b-bf04-3d43411bf390 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:24.452460 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-0ba58375-cb70-494b-bf04-3d43411bf390 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:24.470987 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG dbcounter [-] [118158] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:45:24.591117 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-0ba58375-cb70-494b-bf04-3d43411bf390 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb4b0cf5f8b4274b787f327793964f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ba26b86c7243dab8e6c6b84ed674e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:24.599089 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-0ba58375-cb70-494b-bf04-3d43411bf390 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6" status: 200 len: 1679 microversion: 2.1 time: 0.159682 Jun 07 14:45:24.599691 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 310/611] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:45:24 2022] GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:45:24.628159 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-5e13c3e5-f59f-4d4c-9550-f1e664936256 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:45:24.628838 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-5e13c3e5-f59f-4d4c-9550-f1e664936256 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 7dec201c-634b-4b93-bc30-0ac8e60795c7] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:45:24.636106 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-5e13c3e5-f59f-4d4c-9550-f1e664936256 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:24.636597 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-5e13c3e5-f59f-4d4c-9550-f1e664936256 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:24.637363 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-5e13c3e5-f59f-4d4c-9550-f1e664936256 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:24.637794 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-5e13c3e5-f59f-4d4c-9550-f1e664936256 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:24.771533 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-5e13c3e5-f59f-4d4c-9550-f1e664936256 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:24.779678 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-5e13c3e5-f59f-4d4c-9550-f1e664936256 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7" status: 200 len: 1728 microversion: 2.1 time: 0.155391 Jun 07 14:45:24.780241 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 302/612] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:45:24 2022] GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7 => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:45:24.796821 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-8d159359-8f34-4cf0-95b4-7aceadaa72c0 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:45:24.797374 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-8d159359-8f34-4cf0-95b4-7aceadaa72c0 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 7dec201c-634b-4b93-bc30-0ac8e60795c7] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:45:24.803834 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-8d159359-8f34-4cf0-95b4-7aceadaa72c0 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:24.804284 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-8d159359-8f34-4cf0-95b4-7aceadaa72c0 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:24.805072 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-8d159359-8f34-4cf0-95b4-7aceadaa72c0 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:24.805511 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-8d159359-8f34-4cf0-95b4-7aceadaa72c0 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:24.881496 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-8d159359-8f34-4cf0-95b4-7aceadaa72c0 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088695 Jun 07 14:45:24.882081 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 311/613] 10.222.0.85 () {58 vars in 1274 bytes} [Tue Jun 7 14:45:24 2022] GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:45:24.981661 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-c005c72d-ef76-4ddd-83b4-7c30cb31d62a tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:45:24.982195 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-c005c72d-ef76-4ddd-83b4-7c30cb31d62a tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] [instance: a185db4f-620b-4359-a1ad-7f4efba9c869] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:45:24.988126 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-c005c72d-ef76-4ddd-83b4-7c30cb31d62a tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:24.988609 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-c005c72d-ef76-4ddd-83b4-7c30cb31d62a tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:24.989377 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-c005c72d-ef76-4ddd-83b4-7c30cb31d62a tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:24.989816 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-c005c72d-ef76-4ddd-83b4-7c30cb31d62a tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:25.125040 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-c005c72d-ef76-4ddd-83b4-7c30cb31d62a tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a605008cb5474f168f572fd0a9e71193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634574e706ee4f31bf4446871f11d5e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:25.132881 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-c005c72d-ef76-4ddd-83b4-7c30cb31d62a tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] 10.222.0.85 "GET /compute/v2.1/servers/a185db4f-620b-4359-a1ad-7f4efba9c869" status: 200 len: 1513 microversion: 2.1 time: 0.155839 Jun 07 14:45:25.133438 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 303/614] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:45:24 2022] GET /compute/v2.1/servers/a185db4f-620b-4359-a1ad-7f4efba9c869 => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:45:25.622551 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-ea9b1bd7-7d5b-4004-9b89-9515f4455711 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:45:25.623123 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-ea9b1bd7-7d5b-4004-9b89-9515f4455711 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:45:25.629581 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-ea9b1bd7-7d5b-4004-9b89-9515f4455711 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:25.630026 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-ea9b1bd7-7d5b-4004-9b89-9515f4455711 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:25.630789 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-ea9b1bd7-7d5b-4004-9b89-9515f4455711 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:25.631220 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-ea9b1bd7-7d5b-4004-9b89-9515f4455711 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:25.927915 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-ea9b1bd7-7d5b-4004-9b89-9515f4455711 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb4b0cf5f8b4274b787f327793964f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ba26b86c7243dab8e6c6b84ed674e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:25.938445 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-ea9b1bd7-7d5b-4004-9b89-9515f4455711 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6" status: 200 len: 1679 microversion: 2.1 time: 0.320922 Jun 07 14:45:25.939483 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 312/615] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:45:25 2022] GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 => generated 1679 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:45:26.073478 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [req-718ee87d-4fa5-4882-b9b2-010de69b39fd req-906cbac0-91f5-430f-a66d-8163ca66c78d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a185db4f-620b-4359-a1ad-7f4efba9c869", "name": "network-vif-deleted", "tag": "cd5fc492-abf3-4504-9ea2-0950cf9629cc"}]} {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:45:26.082211 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [req-718ee87d-4fa5-4882-b9b2-010de69b39fd req-906cbac0-91f5-430f-a66d-8163ca66c78d service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:26.082759 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [req-718ee87d-4fa5-4882-b9b2-010de69b39fd req-906cbac0-91f5-430f-a66d-8163ca66c78d service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:26.095249 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.compute.server_external_events [req-718ee87d-4fa5-4882-b9b2-010de69b39fd req-906cbac0-91f5-430f-a66d-8163ca66c78d service nova] Creating event network-vif-deleted:cd5fc492-abf3-4504-9ea2-0950cf9629cc for instance a185db4f-620b-4359-a1ad-7f4efba9c869 on hv-cinder-84497 Jun 07 14:45:26.101259 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [req-718ee87d-4fa5-4882-b9b2-010de69b39fd req-906cbac0-91f5-430f-a66d-8163ca66c78d service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090340 Jun 07 14:45:26.102379 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 304/616] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jun 7 14:45:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:45:26.151225 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-d554567c-dff5-4e35-8fe6-ec770df5d3ba tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:45:26.151792 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-d554567c-dff5-4e35-8fe6-ec770df5d3ba tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] [instance: a185db4f-620b-4359-a1ad-7f4efba9c869] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:45:26.158502 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-d554567c-dff5-4e35-8fe6-ec770df5d3ba tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:26.158952 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-d554567c-dff5-4e35-8fe6-ec770df5d3ba tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:26.159732 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-d554567c-dff5-4e35-8fe6-ec770df5d3ba tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:26.160168 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-d554567c-dff5-4e35-8fe6-ec770df5d3ba tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:26.310301 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-d554567c-dff5-4e35-8fe6-ec770df5d3ba tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a605008cb5474f168f572fd0a9e71193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634574e706ee4f31bf4446871f11d5e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:26.318586 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-d554567c-dff5-4e35-8fe6-ec770df5d3ba tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] 10.222.0.85 "GET /compute/v2.1/servers/a185db4f-620b-4359-a1ad-7f4efba9c869" status: 200 len: 1471 microversion: 2.1 time: 0.171353 Jun 07 14:45:26.328245 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 313/617] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:45:26 2022] GET /compute/v2.1/servers/a185db4f-620b-4359-a1ad-7f4efba9c869 => generated 1471 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:45:26.958469 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-6baaf6bf-0ae8-4196-b830-2f13aa6aa691 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:45:26.959194 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-6baaf6bf-0ae8-4196-b830-2f13aa6aa691 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:45:26.965888 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-6baaf6bf-0ae8-4196-b830-2f13aa6aa691 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:26.966343 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-6baaf6bf-0ae8-4196-b830-2f13aa6aa691 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:26.967123 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-6baaf6bf-0ae8-4196-b830-2f13aa6aa691 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:26.967557 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-6baaf6bf-0ae8-4196-b830-2f13aa6aa691 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:27.144775 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-6baaf6bf-0ae8-4196-b830-2f13aa6aa691 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb4b0cf5f8b4274b787f327793964f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ba26b86c7243dab8e6c6b84ed674e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:27.161728 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-6baaf6bf-0ae8-4196-b830-2f13aa6aa691 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6" status: 200 len: 1679 microversion: 2.1 time: 0.207437 Jun 07 14:45:27.162980 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 305/618] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:45:26 2022] GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 => generated 1679 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:45:27.335878 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-5b4d014e-ee87-4ecf-8a8a-656df10d0f18 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:45:27.337629 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-5b4d014e-ee87-4ecf-8a8a-656df10d0f18 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] [instance: a185db4f-620b-4359-a1ad-7f4efba9c869] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:45:27.346368 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5b4d014e-ee87-4ecf-8a8a-656df10d0f18 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:27.347691 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5b4d014e-ee87-4ecf-8a8a-656df10d0f18 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:27.348981 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5b4d014e-ee87-4ecf-8a8a-656df10d0f18 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:27.350068 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5b4d014e-ee87-4ecf-8a8a-656df10d0f18 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:27.366059 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.wsgi [None req-5b4d014e-ee87-4ecf-8a8a-656df10d0f18 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] HTTP exception thrown: Instance a185db4f-620b-4359-a1ad-7f4efba9c869 could not be found. Jun 07 14:45:27.368067 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-5b4d014e-ee87-4ecf-8a8a-656df10d0f18 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Request method failure captured: Jun 07 14:45:27.368067 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: request: GET /compute/v2.1/servers/a185db4f-620b-4359-a1ad-7f4efba9c869 HTTP/1.1 Jun 07 14:45:27.368067 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Accept: application/json Jun 07 14:45:27.368067 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Accept-Encoding: identity Jun 07 14:45:27.368067 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Connection: close Jun 07 14:45:27.368067 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Content-Length: 0 Jun 07 14:45:27.368067 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Content-Type: application/json Jun 07 14:45:27.368067 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Host: 10.222.0.85 Jun 07 14:45:27.368067 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Openstack-System-Scope: None Jun 07 14:45:27.368067 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: User-Agent: python-urllib3/1.26.9 Jun 07 14:45:27.368067 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Auth-Token: gAAAAABin2POQAo9iuMxPLtludRtLnl5En_vN9SacRCtpaq0i4t5Rist1SnD-PjHswAImXPBhoNjtaA4rIxEkWAJfWvU24MTViaivZ_ip19g84I0JrsF9Icl-cQVwoo1OG-SGo3zhadGZXjGXGLXx46ZwP-nbbpHx8rvrxfvfZw0N8_vQG6kzqc Jun 07 14:45:27.368067 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Domain-Id: None Jun 07 14:45:27.368067 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Domain-Name: None Jun 07 14:45:27.368067 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Identity-Status: Confirmed Jun 07 14:45:27.368067 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Is-Admin-Project: True Jun 07 14:45:27.368067 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Domain-Id: default Jun 07 14:45:27.368067 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Domain-Name: Default Jun 07 14:45:27.368067 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Id: 634574e706ee4f31bf4446871f11d5e0 Jun 07 14:45:27.368067 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2005701616 Jun 07 14:45:27.368067 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Role: member,reader Jun 07 14:45:27.368067 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Roles: member,reader Jun 07 14:45:27.370084 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/634574e706ee4f31bf4446871f11d5e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_634574e706ee4f31bf4446871f11d5e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/634574e706ee4f31bf4446871f11d5e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/634574e706ee4f31bf4446871f11d5e0"}]}] Jun 07 14:45:27.370084 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Tenant: tempest-VolumesSnapshotTestJSON-2005701616 Jun 07 14:45:27.370084 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Tenant-Id: 634574e706ee4f31bf4446871f11d5e0 Jun 07 14:45:27.370084 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2005701616 Jun 07 14:45:27.370084 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User: tempest-VolumesSnapshotTestJSON-2005701616-project Jun 07 14:45:27.370084 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Domain-Id: default Jun 07 14:45:27.370084 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Domain-Name: Default Jun 07 14:45:27.370084 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Id: a605008cb5474f168f572fd0a9e71193 Jun 07 14:45:27.370084 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Name: tempest-VolumesSnapshotTestJSON-2005701616-project Jun 07 14:45:27.370084 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: method: > Jun 07 14:45:27.370084 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: exception: Instance a185db4f-620b-4359-a1ad-7f4efba9c869 could not be found. Jun 07 14:45:27.370084 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: action_args: {'id': 'a185db4f-620b-4359-a1ad-7f4efba9c869'} Jun 07 14:45:27.370832 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:45:27.370832 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:45:27.370832 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 14:45:27.370832 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 14:45:27.370832 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 14:45:27.370832 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 14:45:27.370832 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 14:45:27.370832 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 14:45:27.370832 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 14:45:27.370832 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 14:45:27.370832 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a185db4f-620b-4359-a1ad-7f4efba9c869 could not be found. Jun 07 14:45:27.370832 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:45:27.370832 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:45:27.370832 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:45:27.370832 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:45:27.370832 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:45:27.370832 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:45:27.370832 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:45:27.370832 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:45:27.370832 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:45:27.372061 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:45:27.372061 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 14:45:27.372061 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 14:45:27.372061 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 14:45:27.372061 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 14:45:27.372061 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 14:45:27.372061 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:45:27.372061 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a185db4f-620b-4359-a1ad-7f4efba9c869 could not be found. Jun 07 14:45:27.372061 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:45:27.372061 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:45:27.372061 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:45:27.372061 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:45:27.372061 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:45:27.372061 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:45:27.372061 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:45:27.372061 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:45:27.372061 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a185db4f-620b-4359-a1ad-7f4efba9c869 could not be found. Jun 07 14:45:27.372061 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:45:27.373200 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-5b4d014e-ee87-4ecf-8a8a-656df10d0f18 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] Returning 404 to user: Instance a185db4f-620b-4359-a1ad-7f4efba9c869 could not be found. {{(pid=118158) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:45:27.373200 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-5b4d014e-ee87-4ecf-8a8a-656df10d0f18 tempest-VolumesSnapshotTestJSON-2005701616 tempest-VolumesSnapshotTestJSON-2005701616-project] 10.222.0.85 "GET /compute/v2.1/servers/a185db4f-620b-4359-a1ad-7f4efba9c869" status: 404 len: 111 microversion: 2.1 time: 0.038703 Jun 07 14:45:27.373200 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 314/619] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:45:27 2022] GET /compute/v2.1/servers/a185db4f-620b-4359-a1ad-7f4efba9c869 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 14:45:28.180473 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-a1fe2863-7c2a-4271-854c-7dac3e41db8b tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:45:28.181146 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-a1fe2863-7c2a-4271-854c-7dac3e41db8b tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:45:28.189405 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-a1fe2863-7c2a-4271-854c-7dac3e41db8b tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:28.190408 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-a1fe2863-7c2a-4271-854c-7dac3e41db8b tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:28.191195 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-a1fe2863-7c2a-4271-854c-7dac3e41db8b tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:28.191693 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-a1fe2863-7c2a-4271-854c-7dac3e41db8b tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:28.283520 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [req-e439851d-f0f6-4eaf-a9c6-ea6a6d0eff2a req-a3ac8021-c324-4034-8d79-3e747f835835 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7dec201c-634b-4b93-bc30-0ac8e60795c7", "tag": "c9370c3f-495d-4859-9ac6-25184d933583"}, {"name": "network-changed", "server_uuid": "7dec201c-634b-4b93-bc30-0ac8e60795c7", "tag": "c9370c3f-495d-4859-9ac6-25184d933583"}]} {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:45:28.292878 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [req-e439851d-f0f6-4eaf-a9c6-ea6a6d0eff2a req-a3ac8021-c324-4034-8d79-3e747f835835 service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:28.293345 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [req-e439851d-f0f6-4eaf-a9c6-ea6a6d0eff2a req-a3ac8021-c324-4034-8d79-3e747f835835 service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:28.310779 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.compute.server_external_events [req-e439851d-f0f6-4eaf-a9c6-ea6a6d0eff2a req-a3ac8021-c324-4034-8d79-3e747f835835 service nova] Creating event network-changed:c9370c3f-495d-4859-9ac6-25184d933583 for instance 7dec201c-634b-4b93-bc30-0ac8e60795c7 on hv-cinder-84497 Jun 07 14:45:28.311301 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.compute.server_external_events [req-e439851d-f0f6-4eaf-a9c6-ea6a6d0eff2a req-a3ac8021-c324-4034-8d79-3e747f835835 service nova] Creating event network-changed:c9370c3f-495d-4859-9ac6-25184d933583 for instance 7dec201c-634b-4b93-bc30-0ac8e60795c7 on hv-cinder-84497 Jun 07 14:45:28.316794 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [req-e439851d-f0f6-4eaf-a9c6-ea6a6d0eff2a req-a3ac8021-c324-4034-8d79-3e747f835835 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.039292 Jun 07 14:45:28.317390 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 315/620] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jun 7 14:45:28 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 14:45:28.354925 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-a1fe2863-7c2a-4271-854c-7dac3e41db8b tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb4b0cf5f8b4274b787f327793964f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ba26b86c7243dab8e6c6b84ed674e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:28.366905 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-a1fe2863-7c2a-4271-854c-7dac3e41db8b tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6" status: 200 len: 1679 microversion: 2.1 time: 0.190290 Jun 07 14:45:28.367490 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 306/621] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:45:28 2022] GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 => generated 1679 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:45:29.387286 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-72688c91-6af1-47b4-ac6f-c8b8510271bf tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:45:29.387990 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-72688c91-6af1-47b4-ac6f-c8b8510271bf tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:45:29.394170 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-72688c91-6af1-47b4-ac6f-c8b8510271bf tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:29.394555 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-72688c91-6af1-47b4-ac6f-c8b8510271bf tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:29.395574 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-72688c91-6af1-47b4-ac6f-c8b8510271bf tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:29.396004 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-72688c91-6af1-47b4-ac6f-c8b8510271bf tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:29.586495 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-72688c91-6af1-47b4-ac6f-c8b8510271bf tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb4b0cf5f8b4274b787f327793964f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ba26b86c7243dab8e6c6b84ed674e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:29.594086 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-72688c91-6af1-47b4-ac6f-c8b8510271bf tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6" status: 200 len: 1679 microversion: 2.1 time: 0.212219 Jun 07 14:45:29.594665 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 316/622] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:45:29 2022] GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 => generated 1679 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:45:30.611075 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-a4d4855b-4eb0-49a6-a570-4337064ef8c5 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:45:30.611754 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-a4d4855b-4eb0-49a6-a570-4337064ef8c5 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:45:30.614273 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG dbcounter [-] [118157] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1 {{(pid=118157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:45:30.619021 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-a4d4855b-4eb0-49a6-a570-4337064ef8c5 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:30.620785 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-a4d4855b-4eb0-49a6-a570-4337064ef8c5 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:30.620785 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-a4d4855b-4eb0-49a6-a570-4337064ef8c5 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:30.620785 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-a4d4855b-4eb0-49a6-a570-4337064ef8c5 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:30.750239 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-a4d4855b-4eb0-49a6-a570-4337064ef8c5 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb4b0cf5f8b4274b787f327793964f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ba26b86c7243dab8e6c6b84ed674e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:30.757586 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-a4d4855b-4eb0-49a6-a570-4337064ef8c5 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6" status: 200 len: 1679 microversion: 2.1 time: 0.150476 Jun 07 14:45:30.758135 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 307/623] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:45:30 2022] GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:45:31.775424 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-55826d8e-36bc-4828-8f0e-1e07f5b86cd5 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:45:31.775963 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-55826d8e-36bc-4828-8f0e-1e07f5b86cd5 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:45:31.782415 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-55826d8e-36bc-4828-8f0e-1e07f5b86cd5 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:31.783406 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-55826d8e-36bc-4828-8f0e-1e07f5b86cd5 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:31.784174 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-55826d8e-36bc-4828-8f0e-1e07f5b86cd5 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:31.784656 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-55826d8e-36bc-4828-8f0e-1e07f5b86cd5 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:31.920876 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-55826d8e-36bc-4828-8f0e-1e07f5b86cd5 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb4b0cf5f8b4274b787f327793964f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ba26b86c7243dab8e6c6b84ed674e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:31.928289 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-55826d8e-36bc-4828-8f0e-1e07f5b86cd5 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6" status: 200 len: 1679 microversion: 2.1 time: 0.157318 Jun 07 14:45:31.928869 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 317/624] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:45:31 2022] GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:45:32.946251 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-3ba54c43-30e3-4483-8f5a-2ccc95f84659 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:45:32.946918 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-3ba54c43-30e3-4483-8f5a-2ccc95f84659 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:45:32.954052 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-3ba54c43-30e3-4483-8f5a-2ccc95f84659 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:32.954506 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-3ba54c43-30e3-4483-8f5a-2ccc95f84659 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:32.955281 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-3ba54c43-30e3-4483-8f5a-2ccc95f84659 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:32.955722 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-3ba54c43-30e3-4483-8f5a-2ccc95f84659 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:33.092282 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-3ba54c43-30e3-4483-8f5a-2ccc95f84659 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb4b0cf5f8b4274b787f327793964f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ba26b86c7243dab8e6c6b84ed674e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:33.099918 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-3ba54c43-30e3-4483-8f5a-2ccc95f84659 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6" status: 200 len: 1679 microversion: 2.1 time: 0.157691 Jun 07 14:45:33.100500 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 308/625] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:45:32 2022] GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:45:34.117564 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-18bc2145-6b15-4e8a-b938-b5d2a8fc2dda tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:45:34.118108 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-18bc2145-6b15-4e8a-b938-b5d2a8fc2dda tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:45:34.120647 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG dbcounter [-] [118158] Writing DB stats nova_api:SELECT=70 {{(pid=118158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:45:34.125349 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-18bc2145-6b15-4e8a-b938-b5d2a8fc2dda tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:34.127292 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-18bc2145-6b15-4e8a-b938-b5d2a8fc2dda tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:34.127292 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-18bc2145-6b15-4e8a-b938-b5d2a8fc2dda tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:34.127292 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-18bc2145-6b15-4e8a-b938-b5d2a8fc2dda tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:34.258664 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-18bc2145-6b15-4e8a-b938-b5d2a8fc2dda tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb4b0cf5f8b4274b787f327793964f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ba26b86c7243dab8e6c6b84ed674e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:34.266370 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-18bc2145-6b15-4e8a-b938-b5d2a8fc2dda tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6" status: 200 len: 1679 microversion: 2.1 time: 0.152822 Jun 07 14:45:34.266935 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 318/626] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:45:34 2022] GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:45:35.283653 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-9f9e9e28-e07b-4da4-a90b-ed9f973c0bde tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:45:35.284176 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-9f9e9e28-e07b-4da4-a90b-ed9f973c0bde tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:45:35.290770 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-9f9e9e28-e07b-4da4-a90b-ed9f973c0bde tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:35.291242 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-9f9e9e28-e07b-4da4-a90b-ed9f973c0bde tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:35.292556 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-9f9e9e28-e07b-4da4-a90b-ed9f973c0bde tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:35.292999 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-9f9e9e28-e07b-4da4-a90b-ed9f973c0bde tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:35.418665 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-9f9e9e28-e07b-4da4-a90b-ed9f973c0bde tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb4b0cf5f8b4274b787f327793964f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ba26b86c7243dab8e6c6b84ed674e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:35.425957 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-9f9e9e28-e07b-4da4-a90b-ed9f973c0bde tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6" status: 200 len: 1679 microversion: 2.1 time: 0.146321 Jun 07 14:45:35.426505 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 309/627] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:45:35 2022] GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 => generated 1679 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:45:36.443284 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-3acec8d5-d2f6-45f5-b956-eec94bef0dbb tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:45:36.443962 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-3acec8d5-d2f6-45f5-b956-eec94bef0dbb tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:45:36.450646 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-3acec8d5-d2f6-45f5-b956-eec94bef0dbb tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:36.451101 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-3acec8d5-d2f6-45f5-b956-eec94bef0dbb tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:36.451871 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-3acec8d5-d2f6-45f5-b956-eec94bef0dbb tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:36.452362 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-3acec8d5-d2f6-45f5-b956-eec94bef0dbb tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:36.580771 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-3acec8d5-d2f6-45f5-b956-eec94bef0dbb tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb4b0cf5f8b4274b787f327793964f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ba26b86c7243dab8e6c6b84ed674e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:36.588127 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-3acec8d5-d2f6-45f5-b956-eec94bef0dbb tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6" status: 200 len: 1679 microversion: 2.1 time: 0.148774 Jun 07 14:45:36.589263 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 319/628] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:45:36 2022] GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 => generated 1679 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:45:37.606110 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-e8be8acd-d3a8-403b-b5b7-b7272e0f64c1 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:45:37.607229 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-e8be8acd-d3a8-403b-b5b7-b7272e0f64c1 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:45:37.613847 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-e8be8acd-d3a8-403b-b5b7-b7272e0f64c1 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:37.614422 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-e8be8acd-d3a8-403b-b5b7-b7272e0f64c1 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:37.615268 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-e8be8acd-d3a8-403b-b5b7-b7272e0f64c1 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:37.615732 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-e8be8acd-d3a8-403b-b5b7-b7272e0f64c1 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:37.750279 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-e8be8acd-d3a8-403b-b5b7-b7272e0f64c1 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb4b0cf5f8b4274b787f327793964f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ba26b86c7243dab8e6c6b84ed674e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:37.758185 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-e8be8acd-d3a8-403b-b5b7-b7272e0f64c1 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6" status: 200 len: 1679 microversion: 2.1 time: 0.156135 Jun 07 14:45:37.758747 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 310/629] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:45:37 2022] GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:45:38.775238 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-a3a24797-072b-4e7a-891d-a1ac8dfb1333 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:45:38.775927 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-a3a24797-072b-4e7a-891d-a1ac8dfb1333 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:45:38.782424 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-a3a24797-072b-4e7a-891d-a1ac8dfb1333 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:38.782881 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-a3a24797-072b-4e7a-891d-a1ac8dfb1333 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:38.783678 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-a3a24797-072b-4e7a-891d-a1ac8dfb1333 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:38.784133 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-a3a24797-072b-4e7a-891d-a1ac8dfb1333 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:38.925099 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-a3a24797-072b-4e7a-891d-a1ac8dfb1333 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb4b0cf5f8b4274b787f327793964f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ba26b86c7243dab8e6c6b84ed674e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:38.932588 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-a3a24797-072b-4e7a-891d-a1ac8dfb1333 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6" status: 200 len: 1656 microversion: 2.1 time: 0.161198 Jun 07 14:45:38.938693 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 320/630] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:45:38 2022] GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 => generated 1656 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:45:38.949750 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-0776058d-3714-44d5-b9c5-fd48a6d1bf6f tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:45:38.955889 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-0776058d-3714-44d5-b9c5-fd48a6d1bf6f tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:38.956337 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-0776058d-3714-44d5-b9c5-fd48a6d1bf6f tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:38.978468 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-0776058d-3714-44d5-b9c5-fd48a6d1bf6f tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6] Going to try to start instance {{(pid=118157) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 07 14:45:39.214784 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-0776058d-3714-44d5-b9c5-fd48a6d1bf6f tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "POST /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6/action" status: 202 len: 0 microversion: 2.1 time: 0.268819 Jun 07 14:45:39.215397 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 311/631] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Jun 7 14:45:38 2022] POST /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6/action => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 14:45:39.224171 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-25943860-73b6-47dd-ab38-1e8aa25687c1 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:45:39.224957 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-25943860-73b6-47dd-ab38-1e8aa25687c1 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:45:39.231050 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-25943860-73b6-47dd-ab38-1e8aa25687c1 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:39.231576 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-25943860-73b6-47dd-ab38-1e8aa25687c1 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:39.233251 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-25943860-73b6-47dd-ab38-1e8aa25687c1 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:39.233648 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-25943860-73b6-47dd-ab38-1e8aa25687c1 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:39.362931 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-25943860-73b6-47dd-ab38-1e8aa25687c1 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb4b0cf5f8b4274b787f327793964f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ba26b86c7243dab8e6c6b84ed674e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:39.370394 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-25943860-73b6-47dd-ab38-1e8aa25687c1 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6" status: 200 len: 1665 microversion: 2.1 time: 0.150188 Jun 07 14:45:39.370894 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 321/632] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:45:39 2022] GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 => generated 1665 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:45:40.388964 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-f4309b78-6e7b-48d4-9146-8a8d7c61cb36 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:45:40.389673 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-f4309b78-6e7b-48d4-9146-8a8d7c61cb36 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:45:40.396097 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-f4309b78-6e7b-48d4-9146-8a8d7c61cb36 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:40.396586 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-f4309b78-6e7b-48d4-9146-8a8d7c61cb36 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:40.397354 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-f4309b78-6e7b-48d4-9146-8a8d7c61cb36 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:40.397789 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-f4309b78-6e7b-48d4-9146-8a8d7c61cb36 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:40.527771 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-f4309b78-6e7b-48d4-9146-8a8d7c61cb36 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb4b0cf5f8b4274b787f327793964f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ba26b86c7243dab8e6c6b84ed674e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:40.540811 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-f4309b78-6e7b-48d4-9146-8a8d7c61cb36 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6" status: 200 len: 1665 microversion: 2.1 time: 0.156468 Jun 07 14:45:40.541665 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 312/633] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:45:40 2022] GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 => generated 1665 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:45:41.558768 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-63c20f4f-b4f5-4563-88b3-f2dc2ce3c5cf tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:45:41.559380 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-63c20f4f-b4f5-4563-88b3-f2dc2ce3c5cf tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:45:41.566411 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-63c20f4f-b4f5-4563-88b3-f2dc2ce3c5cf tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:41.566862 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-63c20f4f-b4f5-4563-88b3-f2dc2ce3c5cf tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:41.568060 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-63c20f4f-b4f5-4563-88b3-f2dc2ce3c5cf tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:41.568060 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-63c20f4f-b4f5-4563-88b3-f2dc2ce3c5cf tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:41.695685 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-63c20f4f-b4f5-4563-88b3-f2dc2ce3c5cf tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb4b0cf5f8b4274b787f327793964f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ba26b86c7243dab8e6c6b84ed674e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:41.703112 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-63c20f4f-b4f5-4563-88b3-f2dc2ce3c5cf tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6" status: 200 len: 1665 microversion: 2.1 time: 0.148211 Jun 07 14:45:41.703670 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 322/634] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:45:41 2022] GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 => generated 1665 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:45:42.720691 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-fedbb763-c7a4-498b-8461-f1d2c0865d56 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:45:42.721312 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-fedbb763-c7a4-498b-8461-f1d2c0865d56 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:45:42.727945 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-fedbb763-c7a4-498b-8461-f1d2c0865d56 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:42.728432 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-fedbb763-c7a4-498b-8461-f1d2c0865d56 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:42.729203 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-fedbb763-c7a4-498b-8461-f1d2c0865d56 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:42.729645 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-fedbb763-c7a4-498b-8461-f1d2c0865d56 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:42.863258 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-fedbb763-c7a4-498b-8461-f1d2c0865d56 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb4b0cf5f8b4274b787f327793964f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ba26b86c7243dab8e6c6b84ed674e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:42.870699 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-fedbb763-c7a4-498b-8461-f1d2c0865d56 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6" status: 200 len: 1665 microversion: 2.1 time: 0.153999 Jun 07 14:45:42.871258 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 313/635] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:45:42 2022] GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 => generated 1665 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:45:43.887752 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-9bbc9d3a-9137-4e5f-815a-32aff193547e tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:45:43.888389 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-9bbc9d3a-9137-4e5f-815a-32aff193547e tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:45:43.895768 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-9bbc9d3a-9137-4e5f-815a-32aff193547e tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:43.896219 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-9bbc9d3a-9137-4e5f-815a-32aff193547e tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:43.897020 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-9bbc9d3a-9137-4e5f-815a-32aff193547e tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:43.897497 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-9bbc9d3a-9137-4e5f-815a-32aff193547e tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:44.029804 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-9bbc9d3a-9137-4e5f-815a-32aff193547e tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb4b0cf5f8b4274b787f327793964f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ba26b86c7243dab8e6c6b84ed674e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:44.037420 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-9bbc9d3a-9137-4e5f-815a-32aff193547e tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6" status: 200 len: 1665 microversion: 2.1 time: 0.153547 Jun 07 14:45:44.037964 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 323/636] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:45:43 2022] GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 => generated 1665 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:45:45.054226 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-a354c919-0d34-4f1b-88f9-6978af78960f tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:45:45.054843 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-a354c919-0d34-4f1b-88f9-6978af78960f tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:45:45.061427 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-a354c919-0d34-4f1b-88f9-6978af78960f tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:45.061884 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-a354c919-0d34-4f1b-88f9-6978af78960f tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:45.062651 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-a354c919-0d34-4f1b-88f9-6978af78960f tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:45.063092 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-a354c919-0d34-4f1b-88f9-6978af78960f tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:45.202724 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-a354c919-0d34-4f1b-88f9-6978af78960f tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb4b0cf5f8b4274b787f327793964f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ba26b86c7243dab8e6c6b84ed674e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:45.210345 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-a354c919-0d34-4f1b-88f9-6978af78960f tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6" status: 200 len: 1665 microversion: 2.1 time: 0.160006 Jun 07 14:45:45.210837 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 314/637] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:45:45 2022] GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 => generated 1665 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:45:46.212892 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-7947a4a5-5bc8-48cd-9400-1b6c886c5443 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:45:46.213434 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-7947a4a5-5bc8-48cd-9400-1b6c886c5443 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: a06b2dd5-e4da-4f12-ba52-40a6527f8d60] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:45:46.219265 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-7947a4a5-5bc8-48cd-9400-1b6c886c5443 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:46.219710 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-7947a4a5-5bc8-48cd-9400-1b6c886c5443 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:46.220500 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-7947a4a5-5bc8-48cd-9400-1b6c886c5443 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:46.220933 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-7947a4a5-5bc8-48cd-9400-1b6c886c5443 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:46.226859 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-a36ee81e-9d66-438b-95c0-d4dac49c4ba0 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:45:46.227469 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-a36ee81e-9d66-438b-95c0-d4dac49c4ba0 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:45:46.233860 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-a36ee81e-9d66-438b-95c0-d4dac49c4ba0 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:46.234303 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-a36ee81e-9d66-438b-95c0-d4dac49c4ba0 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:46.235069 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-a36ee81e-9d66-438b-95c0-d4dac49c4ba0 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:46.235497 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-a36ee81e-9d66-438b-95c0-d4dac49c4ba0 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:46.244179 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-7947a4a5-5bc8-48cd-9400-1b6c886c5443 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/a06b2dd5-e4da-4f12-ba52-40a6527f8d60/ips" status: 200 len: 150 microversion: 2.1 time: 0.091838 Jun 07 14:45:46.244848 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 324/638] 10.222.0.85 () {58 vars in 1247 bytes} [Tue Jun 7 14:45:46 2022] GET /compute/v2.1/servers/a06b2dd5-e4da-4f12-ba52-40a6527f8d60/ips => generated 150 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:45:46.255584 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-9c1a4771-3cd8-4833-aee7-a7d556f20457 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "833f78c8-54e1-460f-914b-b6b6b716612b"}} {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:45:46.256718 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-9c1a4771-3cd8-4833-aee7-a7d556f20457 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: a06b2dd5-e4da-4f12-ba52-40a6527f8d60] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:45:46.262471 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-9c1a4771-3cd8-4833-aee7-a7d556f20457 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:46.262914 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-9c1a4771-3cd8-4833-aee7-a7d556f20457 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:46.263664 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-9c1a4771-3cd8-4833-aee7-a7d556f20457 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:46.264673 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-9c1a4771-3cd8-4833-aee7-a7d556f20457 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:46.343259 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.wsgi [None req-9c1a4771-3cd8-4833-aee7-a7d556f20457 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] HTTP exception thrown: Invalid volume: volume 833f78c8-54e1-460f-914b-b6b6b716612b is already attached to instances: 314a1177-9252-4a27-8c30-0b7af796d9a5 Jun 07 14:45:46.345119 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-9c1a4771-3cd8-4833-aee7-a7d556f20457 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Request method failure captured: Jun 07 14:45:46.345119 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: request: POST /compute/v2.1/servers/a06b2dd5-e4da-4f12-ba52-40a6527f8d60/os-volume_attachments HTTP/1.1 Jun 07 14:45:46.345119 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Accept: application/json Jun 07 14:45:46.345119 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Accept-Encoding: identity Jun 07 14:45:46.345119 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Connection: close Jun 07 14:45:46.345119 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Content-Length: 74 Jun 07 14:45:46.345119 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Content-Type: application/json Jun 07 14:45:46.345119 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Host: 10.222.0.85 Jun 07 14:45:46.345119 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Openstack-System-Scope: None Jun 07 14:45:46.345119 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: User-Agent: python-urllib3/1.26.9 Jun 07 14:45:46.345119 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Auth-Token: gAAAAABin2MfTRQCz8-nJ9l6FZbbvZHr4ehXByNi3Z0iSJmei7E9Un8HbsXaII7Zrv5LEnKmQb4d93wyNQqjAkp1IKVfs3yISIEXnMvfKr46BwDX3CxPmlHLkbdOk4RqVmIQcl_yARDnVkQjkCk9boV0Z6LD9SMz4Q7cu_osT-ds_ddwKKWxW2w Jun 07 14:45:46.345119 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Domain-Id: None Jun 07 14:45:46.345119 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Domain-Name: None Jun 07 14:45:46.345119 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Identity-Status: Confirmed Jun 07 14:45:46.345119 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Is-Admin-Project: True Jun 07 14:45:46.345119 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Domain-Id: default Jun 07 14:45:46.345119 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Domain-Name: Default Jun 07 14:45:46.345119 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Id: 8eae64ee53144e4f8d583bb4288c0aeb Jun 07 14:45:46.345119 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Name: tempest-AttachVolumeNegativeTest-1508033184 Jun 07 14:45:46.345119 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Role: member,reader Jun 07 14:45:46.345119 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Roles: member,reader Jun 07 14:45:46.346601 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8eae64ee53144e4f8d583bb4288c0aeb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_8eae64ee53144e4f8d583bb4288c0aeb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8eae64ee53144e4f8d583bb4288c0aeb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/8eae64ee53144e4f8d583bb4288c0aeb"}]}] Jun 07 14:45:46.346601 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Tenant: tempest-AttachVolumeNegativeTest-1508033184 Jun 07 14:45:46.346601 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Tenant-Id: 8eae64ee53144e4f8d583bb4288c0aeb Jun 07 14:45:46.346601 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1508033184 Jun 07 14:45:46.346601 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User: tempest-AttachVolumeNegativeTest-1508033184-project Jun 07 14:45:46.346601 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Domain-Id: default Jun 07 14:45:46.346601 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Domain-Name: Default Jun 07 14:45:46.346601 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Id: 34eb9ec1f3ff44bbb03cf934cb2a04de Jun 07 14:45:46.346601 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Name: tempest-AttachVolumeNegativeTest-1508033184-project Jun 07 14:45:46.346601 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Jun 07 14:45:46.346601 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: {"volumeAttachment": {"volumeId": "833f78c8-54e1-460f-914b-b6b6b716612b"}} Jun 07 14:45:46.346601 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: method: > Jun 07 14:45:46.351446 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: exception: Invalid volume: volume 833f78c8-54e1-460f-914b-b6b6b716612b is already attached to instances: 314a1177-9252-4a27-8c30-0b7af796d9a5 Jun 07 14:45:46.351446 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: action_args: {'server_id': 'a06b2dd5-e4da-4f12-ba52-40a6527f8d60', 'body': {'volumeAttachment': {'volumeId': '833f78c8-54e1-460f-914b-b6b6b716612b'}}} Jun 07 14:45:46.351446 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:45:46.351446 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:45:46.351446 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 07 14:45:46.351446 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 07 14:45:46.351446 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 07 14:45:46.351446 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 07 14:45:46.351446 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 07 14:45:46.351446 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 07 14:45:46.351446 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 07 14:45:46.351446 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 07 14:45:46.351446 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 07 14:45:46.351446 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 07 14:45:46.351446 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 833f78c8-54e1-460f-914b-b6b6b716612b is already attached to instances: 314a1177-9252-4a27-8c30-0b7af796d9a5 Jun 07 14:45:46.351446 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:45:46.351446 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:45:46.351446 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:45:46.351446 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:45:46.352866 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:45:46.352866 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:45:46.352866 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:45:46.352866 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:45:46.352866 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:45:46.352866 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:45:46.352866 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 07 14:45:46.352866 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 14:45:46.352866 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 07 14:45:46.352866 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 14:45:46.352866 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 07 14:45:46.352866 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 14:45:46.352866 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 07 14:45:46.352866 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 07 14:45:46.352866 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 833f78c8-54e1-460f-914b-b6b6b716612b is already attached to instances: 314a1177-9252-4a27-8c30-0b7af796d9a5 Jun 07 14:45:46.352866 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:45:46.352866 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:45:46.352866 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:45:46.352866 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:45:46.352866 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:45:46.354243 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:45:46.354243 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:45:46.354243 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:45:46.354243 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 833f78c8-54e1-460f-914b-b6b6b716612b is already attached to instances: 314a1177-9252-4a27-8c30-0b7af796d9a5 Jun 07 14:45:46.354243 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:45:46.354243 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-9c1a4771-3cd8-4833-aee7-a7d556f20457 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Returning 400 to user: Invalid volume: volume 833f78c8-54e1-460f-914b-b6b6b716612b is already attached to instances: 314a1177-9252-4a27-8c30-0b7af796d9a5 {{(pid=118158) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:45:46.354243 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-9c1a4771-3cd8-4833-aee7-a7d556f20457 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "POST /compute/v2.1/servers/a06b2dd5-e4da-4f12-ba52-40a6527f8d60/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.094750 Jun 07 14:45:46.354243 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 325/639] 10.222.0.85 () {60 vars in 1322 bytes} [Tue Jun 7 14:45:46 2022] POST /compute/v2.1/servers/a06b2dd5-e4da-4f12-ba52-40a6527f8d60/os-volume_attachments => generated 174 bytes in 96 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 07 14:45:46.355171 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-15c65691-86a5-499b-952f-413c6476e3f8 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:45:46.355677 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-15c65691-86a5-499b-952f-413c6476e3f8 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: a06b2dd5-e4da-4f12-ba52-40a6527f8d60] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:45:46.362948 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-15c65691-86a5-499b-952f-413c6476e3f8 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:46.363406 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-15c65691-86a5-499b-952f-413c6476e3f8 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:46.364183 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-15c65691-86a5-499b-952f-413c6476e3f8 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:46.364652 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-15c65691-86a5-499b-952f-413c6476e3f8 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:46.373004 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-a36ee81e-9d66-438b-95c0-d4dac49c4ba0 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb4b0cf5f8b4274b787f327793964f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ba26b86c7243dab8e6c6b84ed674e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:46.381185 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-a36ee81e-9d66-438b-95c0-d4dac49c4ba0 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6" status: 200 len: 1669 microversion: 2.1 time: 0.158098 Jun 07 14:45:46.381838 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 315/640] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:45:46 2022] GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 => generated 1669 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:45:46.390108 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-15c65691-86a5-499b-952f-413c6476e3f8 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: a06b2dd5-e4da-4f12-ba52-40a6527f8d60] Going to try to terminate instance {{(pid=118158) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 14:45:46.729075 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-15c65691-86a5-499b-952f-413c6476e3f8 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "DELETE /compute/v2.1/servers/a06b2dd5-e4da-4f12-ba52-40a6527f8d60" status: 204 len: 0 microversion: 2.1 time: 0.377201 Jun 07 14:45:46.729650 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 326/641] 10.222.0.85 () {58 vars in 1238 bytes} [Tue Jun 7 14:45:46 2022] DELETE /compute/v2.1/servers/a06b2dd5-e4da-4f12-ba52-40a6527f8d60 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 07 14:45:46.739045 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-7cc914ed-ecae-4d6d-a9da-d1ea94ee73b3 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:45:46.739742 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-7cc914ed-ecae-4d6d-a9da-d1ea94ee73b3 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: a06b2dd5-e4da-4f12-ba52-40a6527f8d60] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:45:46.749492 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-7cc914ed-ecae-4d6d-a9da-d1ea94ee73b3 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:46.749492 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-7cc914ed-ecae-4d6d-a9da-d1ea94ee73b3 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:46.749492 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-7cc914ed-ecae-4d6d-a9da-d1ea94ee73b3 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:46.749492 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-7cc914ed-ecae-4d6d-a9da-d1ea94ee73b3 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:46.885226 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-7cc914ed-ecae-4d6d-a9da-d1ea94ee73b3 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eb9ec1f3ff44bbb03cf934cb2a04de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eae64ee53144e4f8d583bb4288c0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:46.895741 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-7cc914ed-ecae-4d6d-a9da-d1ea94ee73b3 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/a06b2dd5-e4da-4f12-ba52-40a6527f8d60" status: 200 len: 1679 microversion: 2.1 time: 0.160387 Jun 07 14:45:46.896488 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 316/642] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:45:46 2022] GET /compute/v2.1/servers/a06b2dd5-e4da-4f12-ba52-40a6527f8d60 => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:45:47.913207 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-4acfc259-54e0-4177-9dfa-dce77963b343 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:45:47.913900 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-4acfc259-54e0-4177-9dfa-dce77963b343 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: a06b2dd5-e4da-4f12-ba52-40a6527f8d60] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:45:47.920031 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-4acfc259-54e0-4177-9dfa-dce77963b343 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:47.920503 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-4acfc259-54e0-4177-9dfa-dce77963b343 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:47.921250 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-4acfc259-54e0-4177-9dfa-dce77963b343 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:47.921678 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-4acfc259-54e0-4177-9dfa-dce77963b343 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:47.940817 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG dbcounter [-] [118158] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:45:48.052478 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-4acfc259-54e0-4177-9dfa-dce77963b343 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eb9ec1f3ff44bbb03cf934cb2a04de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eae64ee53144e4f8d583bb4288c0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:48.059723 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-4acfc259-54e0-4177-9dfa-dce77963b343 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/a06b2dd5-e4da-4f12-ba52-40a6527f8d60" status: 200 len: 1679 microversion: 2.1 time: 0.150748 Jun 07 14:45:48.060268 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 327/643] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:45:47 2022] GET /compute/v2.1/servers/a06b2dd5-e4da-4f12-ba52-40a6527f8d60 => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:45:49.077074 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-8b9e8b50-4780-4c53-8a8b-911a950d28b7 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:45:49.077695 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-8b9e8b50-4780-4c53-8a8b-911a950d28b7 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: a06b2dd5-e4da-4f12-ba52-40a6527f8d60] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:45:49.084340 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-8b9e8b50-4780-4c53-8a8b-911a950d28b7 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:49.084821 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-8b9e8b50-4780-4c53-8a8b-911a950d28b7 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:49.085592 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-8b9e8b50-4780-4c53-8a8b-911a950d28b7 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:49.086028 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-8b9e8b50-4780-4c53-8a8b-911a950d28b7 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:49.221391 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-8b9e8b50-4780-4c53-8a8b-911a950d28b7 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eb9ec1f3ff44bbb03cf934cb2a04de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eae64ee53144e4f8d583bb4288c0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:49.229183 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-8b9e8b50-4780-4c53-8a8b-911a950d28b7 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/a06b2dd5-e4da-4f12-ba52-40a6527f8d60" status: 200 len: 1679 microversion: 2.1 time: 0.155955 Jun 07 14:45:49.229746 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 317/644] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:45:49 2022] GET /compute/v2.1/servers/a06b2dd5-e4da-4f12-ba52-40a6527f8d60 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:45:50.018015 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [req-fa9b197c-def3-44cc-b435-6c67963f691e req-47d98c3a-4b11-476d-b206-9be47f542153 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a06b2dd5-e4da-4f12-ba52-40a6527f8d60", "name": "network-vif-deleted", "tag": "9131e5ca-5201-41c7-94aa-a5c0e37a07f7"}]} {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:45:50.027909 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [req-fa9b197c-def3-44cc-b435-6c67963f691e req-47d98c3a-4b11-476d-b206-9be47f542153 service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:50.028468 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [req-fa9b197c-def3-44cc-b435-6c67963f691e req-47d98c3a-4b11-476d-b206-9be47f542153 service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:50.041202 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.compute.server_external_events [req-fa9b197c-def3-44cc-b435-6c67963f691e req-47d98c3a-4b11-476d-b206-9be47f542153 service nova] Creating event network-vif-deleted:9131e5ca-5201-41c7-94aa-a5c0e37a07f7 for instance a06b2dd5-e4da-4f12-ba52-40a6527f8d60 on hv-cinder-84497 Jun 07 14:45:50.046862 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [req-fa9b197c-def3-44cc-b435-6c67963f691e req-47d98c3a-4b11-476d-b206-9be47f542153 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032505 Jun 07 14:45:50.047793 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 328/645] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jun 7 14:45:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 14:45:50.246494 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-db84f975-baa8-45e8-9584-eb0569422e25 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:45:50.247204 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-db84f975-baa8-45e8-9584-eb0569422e25 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: a06b2dd5-e4da-4f12-ba52-40a6527f8d60] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:45:50.254504 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-db84f975-baa8-45e8-9584-eb0569422e25 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:50.255317 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-db84f975-baa8-45e8-9584-eb0569422e25 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:50.256176 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-db84f975-baa8-45e8-9584-eb0569422e25 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:50.257302 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-db84f975-baa8-45e8-9584-eb0569422e25 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:50.262229 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG dbcounter [-] [118157] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:45:50.330699 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-db84f975-baa8-45e8-9584-eb0569422e25 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eb9ec1f3ff44bbb03cf934cb2a04de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eae64ee53144e4f8d583bb4288c0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:50.340961 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-db84f975-baa8-45e8-9584-eb0569422e25 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/a06b2dd5-e4da-4f12-ba52-40a6527f8d60" status: 200 len: 1324 microversion: 2.1 time: 0.098169 Jun 07 14:45:50.342110 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 318/646] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:45:50 2022] GET /compute/v2.1/servers/a06b2dd5-e4da-4f12-ba52-40a6527f8d60 => generated 1324 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:45:51.360139 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-67ec0a52-701b-44fb-a285-13b6f01d297a tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:45:51.360850 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-67ec0a52-701b-44fb-a285-13b6f01d297a tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: a06b2dd5-e4da-4f12-ba52-40a6527f8d60] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:45:51.368272 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-67ec0a52-701b-44fb-a285-13b6f01d297a tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:51.368272 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-67ec0a52-701b-44fb-a285-13b6f01d297a tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:51.369199 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-67ec0a52-701b-44fb-a285-13b6f01d297a tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:51.369638 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-67ec0a52-701b-44fb-a285-13b6f01d297a tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:51.385656 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.wsgi [None req-67ec0a52-701b-44fb-a285-13b6f01d297a tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] HTTP exception thrown: Instance a06b2dd5-e4da-4f12-ba52-40a6527f8d60 could not be found. Jun 07 14:45:51.387342 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-67ec0a52-701b-44fb-a285-13b6f01d297a tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Request method failure captured: Jun 07 14:45:51.387342 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: request: GET /compute/v2.1/servers/a06b2dd5-e4da-4f12-ba52-40a6527f8d60 HTTP/1.1 Jun 07 14:45:51.387342 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Accept: application/json Jun 07 14:45:51.387342 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Accept-Encoding: identity Jun 07 14:45:51.387342 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Connection: close Jun 07 14:45:51.387342 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Content-Length: 0 Jun 07 14:45:51.387342 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Content-Type: application/json Jun 07 14:45:51.387342 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Host: 10.222.0.85 Jun 07 14:45:51.387342 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Openstack-System-Scope: None Jun 07 14:45:51.387342 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: User-Agent: python-urllib3/1.26.9 Jun 07 14:45:51.387342 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Auth-Token: gAAAAABin2MfTRQCz8-nJ9l6FZbbvZHr4ehXByNi3Z0iSJmei7E9Un8HbsXaII7Zrv5LEnKmQb4d93wyNQqjAkp1IKVfs3yISIEXnMvfKr46BwDX3CxPmlHLkbdOk4RqVmIQcl_yARDnVkQjkCk9boV0Z6LD9SMz4Q7cu_osT-ds_ddwKKWxW2w Jun 07 14:45:51.387342 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Domain-Id: None Jun 07 14:45:51.387342 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Domain-Name: None Jun 07 14:45:51.387342 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Identity-Status: Confirmed Jun 07 14:45:51.387342 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Is-Admin-Project: True Jun 07 14:45:51.387342 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Domain-Id: default Jun 07 14:45:51.387342 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Domain-Name: Default Jun 07 14:45:51.387342 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Id: 8eae64ee53144e4f8d583bb4288c0aeb Jun 07 14:45:51.387342 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Name: tempest-AttachVolumeNegativeTest-1508033184 Jun 07 14:45:51.387342 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Role: member,reader Jun 07 14:45:51.387342 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Roles: member,reader Jun 07 14:45:51.388709 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8eae64ee53144e4f8d583bb4288c0aeb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_8eae64ee53144e4f8d583bb4288c0aeb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8eae64ee53144e4f8d583bb4288c0aeb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/8eae64ee53144e4f8d583bb4288c0aeb"}]}] Jun 07 14:45:51.388709 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Tenant: tempest-AttachVolumeNegativeTest-1508033184 Jun 07 14:45:51.388709 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Tenant-Id: 8eae64ee53144e4f8d583bb4288c0aeb Jun 07 14:45:51.388709 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1508033184 Jun 07 14:45:51.388709 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User: tempest-AttachVolumeNegativeTest-1508033184-project Jun 07 14:45:51.388709 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Domain-Id: default Jun 07 14:45:51.388709 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Domain-Name: Default Jun 07 14:45:51.388709 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Id: 34eb9ec1f3ff44bbb03cf934cb2a04de Jun 07 14:45:51.388709 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Name: tempest-AttachVolumeNegativeTest-1508033184-project Jun 07 14:45:51.388709 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: method: > Jun 07 14:45:51.388709 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: exception: Instance a06b2dd5-e4da-4f12-ba52-40a6527f8d60 could not be found. Jun 07 14:45:51.388709 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: action_args: {'id': 'a06b2dd5-e4da-4f12-ba52-40a6527f8d60'} Jun 07 14:45:51.389409 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:45:51.389409 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:45:51.389409 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 14:45:51.389409 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 14:45:51.389409 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 14:45:51.389409 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 14:45:51.389409 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 14:45:51.389409 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 14:45:51.389409 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 14:45:51.389409 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 14:45:51.389409 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a06b2dd5-e4da-4f12-ba52-40a6527f8d60 could not be found. Jun 07 14:45:51.389409 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:45:51.389409 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:45:51.389409 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:45:51.389409 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:45:51.389409 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:45:51.389409 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:45:51.389409 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:45:51.389409 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:45:51.389409 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:45:51.391724 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:45:51.391724 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 14:45:51.391724 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 14:45:51.391724 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 14:45:51.391724 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 14:45:51.391724 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 14:45:51.391724 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:45:51.391724 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a06b2dd5-e4da-4f12-ba52-40a6527f8d60 could not be found. Jun 07 14:45:51.391724 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:45:51.391724 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:45:51.391724 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:45:51.391724 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:45:51.391724 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:45:51.391724 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:45:51.391724 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:45:51.391724 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:45:51.391724 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a06b2dd5-e4da-4f12-ba52-40a6527f8d60 could not be found. Jun 07 14:45:51.391724 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:45:51.393422 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-67ec0a52-701b-44fb-a285-13b6f01d297a tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Returning 404 to user: Instance a06b2dd5-e4da-4f12-ba52-40a6527f8d60 could not be found. {{(pid=118158) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:45:51.393422 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-67ec0a52-701b-44fb-a285-13b6f01d297a tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/a06b2dd5-e4da-4f12-ba52-40a6527f8d60" status: 404 len: 111 microversion: 2.1 time: 0.033554 Jun 07 14:45:51.393422 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 329/647] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:45:51 2022] GET /compute/v2.1/servers/a06b2dd5-e4da-4f12-ba52-40a6527f8d60 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 14:45:51.399456 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-abb6a9a9-1ace-4018-8d5f-6e8f471ee18c tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '.version_select at 0x7f5f82ec30d0>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:45:51.519542 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-abb6a9a9-1ace-4018-8d5f-6e8f471ee18c tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-28063091" status: 202 len: 0 microversion: 2.1 time: 0.124530 Jun 07 14:45:51.520162 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 319/648] 10.222.0.85 () {58 vars in 1214 bytes} [Tue Jun 7 14:45:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-28063091 => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 14:45:52.416354 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-77df5251-48fd-45d5-af62-7dcf57919e5c tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:45:52.417038 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-77df5251-48fd-45d5-af62-7dcf57919e5c tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 314a1177-9252-4a27-8c30-0b7af796d9a5] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:45:52.425036 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-77df5251-48fd-45d5-af62-7dcf57919e5c tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:52.425624 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-77df5251-48fd-45d5-af62-7dcf57919e5c tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:52.427316 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-77df5251-48fd-45d5-af62-7dcf57919e5c tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:52.427818 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-77df5251-48fd-45d5-af62-7dcf57919e5c tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:52.511946 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.objects.instance [None req-77df5251-48fd-45d5-af62-7dcf57919e5c tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lazy-loading 'services' on Instance uuid 314a1177-9252-4a27-8c30-0b7af796d9a5 {{(pid=118158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 14:45:52.865611 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-77df5251-48fd-45d5-af62-7dcf57919e5c tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "DELETE /compute/v2.1/servers/314a1177-9252-4a27-8c30-0b7af796d9a5/os-volume_attachments/833f78c8-54e1-460f-914b-b6b6b716612b" status: 202 len: 0 microversion: 2.1 time: 0.453218 Jun 07 14:45:52.866810 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 330/649] 10.222.0.85 () {58 vars in 1415 bytes} [Tue Jun 7 14:45:52 2022] DELETE /compute/v2.1/servers/314a1177-9252-4a27-8c30-0b7af796d9a5/os-volume_attachments/833f78c8-54e1-460f-914b-b6b6b716612b => generated 0 bytes in 455 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 14:45:52.876471 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-b2b4ba67-dba9-4a9f-9346-1fd3d6f78a45 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:45:52.877522 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-b2b4ba67-dba9-4a9f-9346-1fd3d6f78a45 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 314a1177-9252-4a27-8c30-0b7af796d9a5] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:45:52.884188 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-b2b4ba67-dba9-4a9f-9346-1fd3d6f78a45 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:52.884648 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-b2b4ba67-dba9-4a9f-9346-1fd3d6f78a45 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:52.885407 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-b2b4ba67-dba9-4a9f-9346-1fd3d6f78a45 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:52.885842 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-b2b4ba67-dba9-4a9f-9346-1fd3d6f78a45 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:52.917011 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-b2b4ba67-dba9-4a9f-9346-1fd3d6f78a45 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/314a1177-9252-4a27-8c30-0b7af796d9a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045682 Jun 07 14:45:52.917565 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 320/650] 10.222.0.85 () {58 vars in 1301 bytes} [Tue Jun 7 14:45:52 2022] GET /compute/v2.1/servers/314a1177-9252-4a27-8c30-0b7af796d9a5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:45:53.932785 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-49eb6414-f2a6-4309-9755-25add370b5d3 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:45:53.933714 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-49eb6414-f2a6-4309-9755-25add370b5d3 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 314a1177-9252-4a27-8c30-0b7af796d9a5] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:45:53.940537 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-49eb6414-f2a6-4309-9755-25add370b5d3 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:53.940993 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-49eb6414-f2a6-4309-9755-25add370b5d3 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:53.941780 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-49eb6414-f2a6-4309-9755-25add370b5d3 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:53.942248 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-49eb6414-f2a6-4309-9755-25add370b5d3 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:53.974263 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-49eb6414-f2a6-4309-9755-25add370b5d3 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/314a1177-9252-4a27-8c30-0b7af796d9a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048547 Jun 07 14:45:53.974827 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 331/651] 10.222.0.85 () {58 vars in 1301 bytes} [Tue Jun 7 14:45:53 2022] GET /compute/v2.1/servers/314a1177-9252-4a27-8c30-0b7af796d9a5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:45:54.985928 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-5e463b5d-71af-414a-8a1e-d5689e469642 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:45:54.986829 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-5e463b5d-71af-414a-8a1e-d5689e469642 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 314a1177-9252-4a27-8c30-0b7af796d9a5] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:45:54.995419 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-5e463b5d-71af-414a-8a1e-d5689e469642 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:54.995419 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-5e463b5d-71af-414a-8a1e-d5689e469642 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:54.995419 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-5e463b5d-71af-414a-8a1e-d5689e469642 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:54.995753 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-5e463b5d-71af-414a-8a1e-d5689e469642 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:55.026902 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-5e463b5d-71af-414a-8a1e-d5689e469642 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/314a1177-9252-4a27-8c30-0b7af796d9a5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044970 Jun 07 14:45:55.027456 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 321/652] 10.222.0.85 () {58 vars in 1301 bytes} [Tue Jun 7 14:45:54 2022] GET /compute/v2.1/servers/314a1177-9252-4a27-8c30-0b7af796d9a5/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 07 14:45:55.087689 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-4d41ec45-bb55-49e2-be34-75d7c5041130 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:45:55.088252 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-4d41ec45-bb55-49e2-be34-75d7c5041130 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 314a1177-9252-4a27-8c30-0b7af796d9a5] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:45:55.094892 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-4d41ec45-bb55-49e2-be34-75d7c5041130 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:55.095342 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-4d41ec45-bb55-49e2-be34-75d7c5041130 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:55.096154 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-4d41ec45-bb55-49e2-be34-75d7c5041130 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:55.096627 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-4d41ec45-bb55-49e2-be34-75d7c5041130 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:55.123563 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-4d41ec45-bb55-49e2-be34-75d7c5041130 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 314a1177-9252-4a27-8c30-0b7af796d9a5] Going to try to terminate instance {{(pid=118158) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 14:45:55.409619 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-4d41ec45-bb55-49e2-be34-75d7c5041130 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "DELETE /compute/v2.1/servers/314a1177-9252-4a27-8c30-0b7af796d9a5" status: 204 len: 0 microversion: 2.1 time: 0.325329 Jun 07 14:45:55.410107 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 332/653] 10.222.0.85 () {58 vars in 1238 bytes} [Tue Jun 7 14:45:55 2022] DELETE /compute/v2.1/servers/314a1177-9252-4a27-8c30-0b7af796d9a5 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 14:45:55.418409 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-76c17496-d64e-428c-a81d-8c699ad54cd6 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:45:55.438420 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-76c17496-d64e-428c-a81d-8c699ad54cd6 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 314a1177-9252-4a27-8c30-0b7af796d9a5] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:45:55.438420 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-76c17496-d64e-428c-a81d-8c699ad54cd6 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:55.438420 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-76c17496-d64e-428c-a81d-8c699ad54cd6 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:55.438420 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-76c17496-d64e-428c-a81d-8c699ad54cd6 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:55.438973 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-76c17496-d64e-428c-a81d-8c699ad54cd6 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:55.566642 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-76c17496-d64e-428c-a81d-8c699ad54cd6 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eb9ec1f3ff44bbb03cf934cb2a04de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eae64ee53144e4f8d583bb4288c0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:55.575061 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-76c17496-d64e-428c-a81d-8c699ad54cd6 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/314a1177-9252-4a27-8c30-0b7af796d9a5" status: 200 len: 1682 microversion: 2.1 time: 0.160442 Jun 07 14:45:55.576399 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 322/654] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:45:55 2022] GET /compute/v2.1/servers/314a1177-9252-4a27-8c30-0b7af796d9a5 => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:45:56.601490 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-98608fbc-034d-4e9f-99f1-72b87e3ebbaf tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:45:56.602312 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-98608fbc-034d-4e9f-99f1-72b87e3ebbaf tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 314a1177-9252-4a27-8c30-0b7af796d9a5] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:45:56.609823 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-98608fbc-034d-4e9f-99f1-72b87e3ebbaf tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:56.610260 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-98608fbc-034d-4e9f-99f1-72b87e3ebbaf tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:56.611057 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-98608fbc-034d-4e9f-99f1-72b87e3ebbaf tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:56.611492 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-98608fbc-034d-4e9f-99f1-72b87e3ebbaf tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:57.033494 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-98608fbc-034d-4e9f-99f1-72b87e3ebbaf tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eb9ec1f3ff44bbb03cf934cb2a04de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eae64ee53144e4f8d583bb4288c0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:57.040932 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-98608fbc-034d-4e9f-99f1-72b87e3ebbaf tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/314a1177-9252-4a27-8c30-0b7af796d9a5" status: 200 len: 1682 microversion: 2.1 time: 0.444301 Jun 07 14:45:57.041580 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 333/655] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:45:56 2022] GET /compute/v2.1/servers/314a1177-9252-4a27-8c30-0b7af796d9a5 => generated 1682 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:45:57.635427 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [req-ab5f1991-8923-44bb-b471-a6f645b26b09 req-2371077e-f75e-4350-8338-224db7c01dec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "314a1177-9252-4a27-8c30-0b7af796d9a5", "name": "network-vif-deleted", "tag": "8997ff45-6df9-4130-98b4-85dfcdb44008"}]} {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:45:57.646509 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [req-ab5f1991-8923-44bb-b471-a6f645b26b09 req-2371077e-f75e-4350-8338-224db7c01dec service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:57.646924 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [req-ab5f1991-8923-44bb-b471-a6f645b26b09 req-2371077e-f75e-4350-8338-224db7c01dec service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:57.659551 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.compute.server_external_events [req-ab5f1991-8923-44bb-b471-a6f645b26b09 req-2371077e-f75e-4350-8338-224db7c01dec service nova] Creating event network-vif-deleted:8997ff45-6df9-4130-98b4-85dfcdb44008 for instance 314a1177-9252-4a27-8c30-0b7af796d9a5 on hv-cinder-84497 Jun 07 14:45:57.675836 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [req-ab5f1991-8923-44bb-b471-a6f645b26b09 req-2371077e-f75e-4350-8338-224db7c01dec service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044091 Jun 07 14:45:57.676805 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 323/656] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jun 7 14:45:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:45:58.058555 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-86c2451d-42d1-4d08-800b-33895e7067f5 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:45:58.059335 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-86c2451d-42d1-4d08-800b-33895e7067f5 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 314a1177-9252-4a27-8c30-0b7af796d9a5] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:45:58.069336 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-86c2451d-42d1-4d08-800b-33895e7067f5 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:58.070100 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-86c2451d-42d1-4d08-800b-33895e7067f5 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:58.071177 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-86c2451d-42d1-4d08-800b-33895e7067f5 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:58.072068 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-86c2451d-42d1-4d08-800b-33895e7067f5 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:58.109808 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-86c2451d-42d1-4d08-800b-33895e7067f5 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:58.110571 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-86c2451d-42d1-4d08-800b-33895e7067f5 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:58.111137 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.objects.instance [None req-86c2451d-42d1-4d08-800b-33895e7067f5 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lazy-loading 'fault' on Instance uuid 314a1177-9252-4a27-8c30-0b7af796d9a5 {{(pid=118158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 14:45:58.163457 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-86c2451d-42d1-4d08-800b-33895e7067f5 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eb9ec1f3ff44bbb03cf934cb2a04de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eae64ee53144e4f8d583bb4288c0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:45:58.171675 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-86c2451d-42d1-4d08-800b-33895e7067f5 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/314a1177-9252-4a27-8c30-0b7af796d9a5" status: 200 len: 1331 microversion: 2.1 time: 0.116681 Jun 07 14:45:58.172264 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 334/657] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:45:58 2022] GET /compute/v2.1/servers/314a1177-9252-4a27-8c30-0b7af796d9a5 => generated 1331 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:45:59.190243 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-b72e68a8-ef89-450a-a5ef-f383e3c45597 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:45:59.190963 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-b72e68a8-ef89-450a-a5ef-f383e3c45597 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 314a1177-9252-4a27-8c30-0b7af796d9a5] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:45:59.197430 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-b72e68a8-ef89-450a-a5ef-f383e3c45597 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:59.197884 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-b72e68a8-ef89-450a-a5ef-f383e3c45597 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:59.198662 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-b72e68a8-ef89-450a-a5ef-f383e3c45597 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:45:59.199091 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-b72e68a8-ef89-450a-a5ef-f383e3c45597 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:45:59.214294 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.wsgi [None req-b72e68a8-ef89-450a-a5ef-f383e3c45597 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] HTTP exception thrown: Instance 314a1177-9252-4a27-8c30-0b7af796d9a5 could not be found. Jun 07 14:45:59.216015 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-b72e68a8-ef89-450a-a5ef-f383e3c45597 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Request method failure captured: Jun 07 14:45:59.216015 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: request: GET /compute/v2.1/servers/314a1177-9252-4a27-8c30-0b7af796d9a5 HTTP/1.1 Jun 07 14:45:59.216015 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Accept: application/json Jun 07 14:45:59.216015 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Accept-Encoding: identity Jun 07 14:45:59.216015 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Connection: close Jun 07 14:45:59.216015 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Content-Length: 0 Jun 07 14:45:59.216015 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Content-Type: application/json Jun 07 14:45:59.216015 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Host: 10.222.0.85 Jun 07 14:45:59.216015 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Openstack-System-Scope: None Jun 07 14:45:59.216015 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: User-Agent: python-urllib3/1.26.9 Jun 07 14:45:59.216015 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Auth-Token: gAAAAABin2MfTRQCz8-nJ9l6FZbbvZHr4ehXByNi3Z0iSJmei7E9Un8HbsXaII7Zrv5LEnKmQb4d93wyNQqjAkp1IKVfs3yISIEXnMvfKr46BwDX3CxPmlHLkbdOk4RqVmIQcl_yARDnVkQjkCk9boV0Z6LD9SMz4Q7cu_osT-ds_ddwKKWxW2w Jun 07 14:45:59.216015 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Domain-Id: None Jun 07 14:45:59.216015 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Domain-Name: None Jun 07 14:45:59.216015 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Identity-Status: Confirmed Jun 07 14:45:59.216015 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Is-Admin-Project: True Jun 07 14:45:59.216015 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Project-Domain-Id: default Jun 07 14:45:59.216015 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Project-Domain-Name: Default Jun 07 14:45:59.216015 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Project-Id: 8eae64ee53144e4f8d583bb4288c0aeb Jun 07 14:45:59.216015 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Project-Name: tempest-AttachVolumeNegativeTest-1508033184 Jun 07 14:45:59.216015 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Role: member,reader Jun 07 14:45:59.216015 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Roles: member,reader Jun 07 14:45:59.217648 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8eae64ee53144e4f8d583bb4288c0aeb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_8eae64ee53144e4f8d583bb4288c0aeb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8eae64ee53144e4f8d583bb4288c0aeb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/8eae64ee53144e4f8d583bb4288c0aeb"}]}] Jun 07 14:45:59.217648 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Tenant: tempest-AttachVolumeNegativeTest-1508033184 Jun 07 14:45:59.217648 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Tenant-Id: 8eae64ee53144e4f8d583bb4288c0aeb Jun 07 14:45:59.217648 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1508033184 Jun 07 14:45:59.217648 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User: tempest-AttachVolumeNegativeTest-1508033184-project Jun 07 14:45:59.217648 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User-Domain-Id: default Jun 07 14:45:59.217648 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User-Domain-Name: Default Jun 07 14:45:59.217648 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User-Id: 34eb9ec1f3ff44bbb03cf934cb2a04de Jun 07 14:45:59.217648 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User-Name: tempest-AttachVolumeNegativeTest-1508033184-project Jun 07 14:45:59.217648 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: method: > Jun 07 14:45:59.217648 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: exception: Instance 314a1177-9252-4a27-8c30-0b7af796d9a5 could not be found. Jun 07 14:45:59.217648 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: action_args: {'id': '314a1177-9252-4a27-8c30-0b7af796d9a5'} Jun 07 14:45:59.222628 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:45:59.222628 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:45:59.222628 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 14:45:59.222628 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 14:45:59.222628 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 14:45:59.222628 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 14:45:59.222628 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 14:45:59.222628 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 14:45:59.222628 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 14:45:59.222628 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 14:45:59.222628 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 314a1177-9252-4a27-8c30-0b7af796d9a5 could not be found. Jun 07 14:45:59.222628 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:45:59.222628 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:45:59.222628 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:45:59.222628 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:45:59.222628 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:45:59.222628 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:45:59.222628 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:45:59.222628 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:45:59.222628 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:45:59.224135 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:45:59.224135 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 14:45:59.224135 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 14:45:59.224135 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 14:45:59.224135 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 14:45:59.224135 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 14:45:59.224135 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:45:59.224135 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 314a1177-9252-4a27-8c30-0b7af796d9a5 could not be found. Jun 07 14:45:59.224135 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:45:59.224135 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:45:59.224135 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:45:59.224135 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:45:59.224135 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:45:59.224135 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:45:59.224135 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:45:59.224135 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:45:59.224135 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 314a1177-9252-4a27-8c30-0b7af796d9a5 could not be found. Jun 07 14:45:59.224135 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:45:59.225441 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-b72e68a8-ef89-450a-a5ef-f383e3c45597 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Returning 404 to user: Instance 314a1177-9252-4a27-8c30-0b7af796d9a5 could not be found. {{(pid=118157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:45:59.225441 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-b72e68a8-ef89-450a-a5ef-f383e3c45597 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/314a1177-9252-4a27-8c30-0b7af796d9a5" status: 404 len: 111 microversion: 2.1 time: 0.032305 Jun 07 14:45:59.225441 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 324/658] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:45:59 2022] GET /compute/v2.1/servers/314a1177-9252-4a27-8c30-0b7af796d9a5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 14:45:59.227056 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-3bad127b-dc7f-46a0-965a-12628699e786 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '.version_select at 0x7f5f826baca0>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:45:59.230392 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3bad127b-dc7f-46a0-965a-12628699e786 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [3e6145c6-9f0c-46c6-ad76-75c847939a0e] AMQP server on 10.222.0.85:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 07 14:46:00.242524 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO oslo.messaging._drivers.impl_rabbit [None req-3bad127b-dc7f-46a0-965a-12628699e786 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [3e6145c6-9f0c-46c6-ad76-75c847939a0e] Reconnected to AMQP server on 10.222.0.85:5672 via [amqp] client with port 59506. Jun 07 14:46:00.348791 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-3bad127b-dc7f-46a0-965a-12628699e786 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-785449831" status: 202 len: 0 microversion: 2.1 time: 1.125408 Jun 07 14:46:00.349501 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 335/659] 10.222.0.85 () {58 vars in 1217 bytes} [Tue Jun 7 14:45:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-785449831 => generated 0 bytes in 1127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 07 14:46:01.134759 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-8b0aefef-db47-4a91-b27e-d4dcde2bda7f tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Action: 'create', calling method: .version_select at 0x7f5f82eb8f70>, body: {"keypair": {"name": "tempest-keypair-40951713", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGRITPFIT+gwq/QgMrVBmnVs6fQtfLjzgdCaBFHV1OxwkHhl72aKo135YNLl5VRWvhRkUOau4h1Xorwz/vahA8uV0gCFeZwytnsbUBSvpYgWSNR8HtoHSAqZU/FMyc2JCg=="}} {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:46:01.139249 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG dbcounter [-] [118157] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1 {{(pid=118157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:46:01.150517 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.quota [None req-8b0aefef-db47-4a91-b27e-d4dcde2bda7f tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Getting quotas for project 8eae64ee53144e4f8d583bb4288c0aeb. Resources: {'key_pairs'} {{(pid=118157) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 14:46:01.154508 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.quota [None req-8b0aefef-db47-4a91-b27e-d4dcde2bda7f tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Getting quotas for user 34eb9ec1f3ff44bbb03cf934cb2a04de and project 8eae64ee53144e4f8d583bb4288c0aeb. Resources: {'key_pairs'} {{(pid=118157) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 14:46:01.217866 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-8b0aefef-db47-4a91-b27e-d4dcde2bda7f tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.086842 Jun 07 14:46:01.218372 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 325/660] 10.222.0.85 () {60 vars in 1158 bytes} [Tue Jun 7 14:46:01 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:46:03.379424 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-f70e3a0c-b1b9-4914-91ea-644a2c4bfa83 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-522897995", "imageRef": "7802ce25-d370-43a3-8d85-0257d644d539", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "52ef821c-7cda-47a1-a169-1a51a76fefad"}], "security_groups": [{"name": "tempest-securitygroup--523796626"}], "key_name": "tempest-keypair-40951713", "user_data": "}} {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:46:03.479170 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.network.neutron [None req-f70e3a0c-b1b9-4914-91ea-644a2c4bfa83 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] validate_networks() for [('52ef821c-7cda-47a1-a169-1a51a76fefad', None, None, None, None, None)] {{(pid=118158) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 14:46:03.932561 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.virt.hardware [None req-f70e3a0c-b1b9-4914-91ea-644a2c4bfa83 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Flavor limits 0:0:0 {{(pid=118158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 14:46:03.938771 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.virt.hardware [None req-f70e3a0c-b1b9-4914-91ea-644a2c4bfa83 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Image limits 0:0:0 {{(pid=118158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 14:46:03.938771 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.virt.hardware [None req-f70e3a0c-b1b9-4914-91ea-644a2c4bfa83 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Flavor pref 0:0:0 {{(pid=118158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 14:46:03.938771 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.virt.hardware [None req-f70e3a0c-b1b9-4914-91ea-644a2c4bfa83 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Image pref 0:0:0 {{(pid=118158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 14:46:03.938771 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.virt.hardware [None req-f70e3a0c-b1b9-4914-91ea-644a2c4bfa83 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 14:46:03.943206 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-f70e3a0c-b1b9-4914-91ea-644a2c4bfa83 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:03.943656 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-f70e3a0c-b1b9-4914-91ea-644a2c4bfa83 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:03.944483 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-f70e3a0c-b1b9-4914-91ea-644a2c4bfa83 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:03.944919 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-f70e3a0c-b1b9-4914-91ea-644a2c4bfa83 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:03.962608 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.quota [None req-f70e3a0c-b1b9-4914-91ea-644a2c4bfa83 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Getting quotas for project 8eae64ee53144e4f8d583bb4288c0aeb. Resources: {'instances', 'cores', 'ram'} {{(pid=118158) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 14:46:03.966605 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.quota [None req-f70e3a0c-b1b9-4914-91ea-644a2c4bfa83 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Getting quotas for user 34eb9ec1f3ff44bbb03cf934cb2a04de and project 8eae64ee53144e4f8d583bb4288c0aeb. Resources: {'instances', 'cores', 'ram'} {{(pid=118158) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 14:46:03.978742 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-f70e3a0c-b1b9-4914-91ea-644a2c4bfa83 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Going to run 1 instances... {{(pid=118158) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 14:46:03.980453 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-f70e3a0c-b1b9-4914-91ea-644a2c4bfa83 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 3636f852-d3ce-4505-b21b-3bbfac40d180] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7802ce25-d370-43a3-8d85-0257d644d539',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118158) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 14:46:04.087294 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-f70e3a0c-b1b9-4914-91ea-644a2c4bfa83 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.713362 Jun 07 14:46:04.087934 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 336/661] 10.222.0.85 () {60 vars in 1146 bytes} [Tue Jun 7 14:46:03 2022] POST /compute/v2.1/servers => generated 401 bytes in 715 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 14:46:04.098945 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-558da039-8b62-48d7-80b7-25703aac4da0 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:46:04.100158 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-558da039-8b62-48d7-80b7-25703aac4da0 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 3636f852-d3ce-4505-b21b-3bbfac40d180] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:46:04.155099 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-558da039-8b62-48d7-80b7-25703aac4da0 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eb9ec1f3ff44bbb03cf934cb2a04de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eae64ee53144e4f8d583bb4288c0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:46:04.162415 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-558da039-8b62-48d7-80b7-25703aac4da0 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/3636f852-d3ce-4505-b21b-3bbfac40d180" status: 200 len: 1239 microversion: 2.1 time: 0.068429 Jun 07 14:46:04.167712 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 326/662] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:46:04 2022] GET /compute/v2.1/servers/3636f852-d3ce-4505-b21b-3bbfac40d180 => generated 1239 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:46:05.180835 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-898f4d6c-185d-4604-b72d-96b3c8d839d3 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:46:05.181380 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-898f4d6c-185d-4604-b72d-96b3c8d839d3 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 3636f852-d3ce-4505-b21b-3bbfac40d180] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:46:05.183379 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG dbcounter [-] [118158] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:46:05.188202 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-898f4d6c-185d-4604-b72d-96b3c8d839d3 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:05.189312 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-898f4d6c-185d-4604-b72d-96b3c8d839d3 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:05.190079 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-898f4d6c-185d-4604-b72d-96b3c8d839d3 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:05.190518 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-898f4d6c-185d-4604-b72d-96b3c8d839d3 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:05.256955 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-898f4d6c-185d-4604-b72d-96b3c8d839d3 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eb9ec1f3ff44bbb03cf934cb2a04de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eae64ee53144e4f8d583bb4288c0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:46:05.264492 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-898f4d6c-185d-4604-b72d-96b3c8d839d3 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/3636f852-d3ce-4505-b21b-3bbfac40d180" status: 200 len: 1243 microversion: 2.1 time: 0.088155 Jun 07 14:46:05.265040 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 337/663] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:46:05 2022] GET /compute/v2.1/servers/3636f852-d3ce-4505-b21b-3bbfac40d180 => generated 1243 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:46:06.283588 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-d27ce658-45a2-43a6-abf4-7539c0ab8986 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:46:06.284212 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-d27ce658-45a2-43a6-abf4-7539c0ab8986 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 3636f852-d3ce-4505-b21b-3bbfac40d180] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:46:06.290951 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-d27ce658-45a2-43a6-abf4-7539c0ab8986 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:06.291702 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-d27ce658-45a2-43a6-abf4-7539c0ab8986 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:06.292530 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-d27ce658-45a2-43a6-abf4-7539c0ab8986 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:06.292974 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-d27ce658-45a2-43a6-abf4-7539c0ab8986 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:06.361754 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-d27ce658-45a2-43a6-abf4-7539c0ab8986 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eb9ec1f3ff44bbb03cf934cb2a04de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eae64ee53144e4f8d583bb4288c0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:46:06.369794 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-d27ce658-45a2-43a6-abf4-7539c0ab8986 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/3636f852-d3ce-4505-b21b-3bbfac40d180" status: 200 len: 1309 microversion: 2.1 time: 0.089643 Jun 07 14:46:06.370004 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 327/664] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:46:06 2022] GET /compute/v2.1/servers/3636f852-d3ce-4505-b21b-3bbfac40d180 => generated 1309 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:46:07.387154 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-70ead435-73c8-4df8-bd69-6b64de46a2c2 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:46:07.387770 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-70ead435-73c8-4df8-bd69-6b64de46a2c2 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 3636f852-d3ce-4505-b21b-3bbfac40d180] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:46:07.396038 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-70ead435-73c8-4df8-bd69-6b64de46a2c2 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:07.396461 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-70ead435-73c8-4df8-bd69-6b64de46a2c2 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:07.397199 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-70ead435-73c8-4df8-bd69-6b64de46a2c2 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:07.397632 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-70ead435-73c8-4df8-bd69-6b64de46a2c2 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:07.544061 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-70ead435-73c8-4df8-bd69-6b64de46a2c2 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eb9ec1f3ff44bbb03cf934cb2a04de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eae64ee53144e4f8d583bb4288c0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:46:07.551464 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-70ead435-73c8-4df8-bd69-6b64de46a2c2 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/3636f852-d3ce-4505-b21b-3bbfac40d180" status: 200 len: 1364 microversion: 2.1 time: 0.168282 Jun 07 14:46:07.552023 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 338/665] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:46:07 2022] GET /compute/v2.1/servers/3636f852-d3ce-4505-b21b-3bbfac40d180 => generated 1364 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:46:07.879368 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [req-f868e0f6-5db8-470b-8a04-a260eafb17c0 req-e508d8a2-93e3-414a-a56a-8f2a79277a0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3636f852-d3ce-4505-b21b-3bbfac40d180", "tag": "c503c043-18ef-4c10-a0e7-591b3c3fc023"}]} {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:46:07.888634 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [req-f868e0f6-5db8-470b-8a04-a260eafb17c0 req-e508d8a2-93e3-414a-a56a-8f2a79277a0b service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:07.889339 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [req-f868e0f6-5db8-470b-8a04-a260eafb17c0 req-e508d8a2-93e3-414a-a56a-8f2a79277a0b service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:07.901819 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.compute.server_external_events [req-f868e0f6-5db8-470b-8a04-a260eafb17c0 req-e508d8a2-93e3-414a-a56a-8f2a79277a0b service nova] Creating event network-changed:c503c043-18ef-4c10-a0e7-591b3c3fc023 for instance 3636f852-d3ce-4505-b21b-3bbfac40d180 on hv-cinder-84497 Jun 07 14:46:07.909008 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [req-f868e0f6-5db8-470b-8a04-a260eafb17c0 req-e508d8a2-93e3-414a-a56a-8f2a79277a0b service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036229 Jun 07 14:46:07.909939 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 328/666] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jun 7 14:46:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:46:08.568803 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-5bc5907b-f27b-4d18-a741-514c696b67b2 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:46:08.570216 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-5bc5907b-f27b-4d18-a741-514c696b67b2 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 3636f852-d3ce-4505-b21b-3bbfac40d180] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:46:08.577287 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5bc5907b-f27b-4d18-a741-514c696b67b2 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:08.577745 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5bc5907b-f27b-4d18-a741-514c696b67b2 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:08.578520 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5bc5907b-f27b-4d18-a741-514c696b67b2 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:08.578981 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5bc5907b-f27b-4d18-a741-514c696b67b2 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:08.784156 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-5bc5907b-f27b-4d18-a741-514c696b67b2 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eb9ec1f3ff44bbb03cf934cb2a04de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eae64ee53144e4f8d583bb4288c0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:46:08.791697 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-5bc5907b-f27b-4d18-a741-514c696b67b2 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/3636f852-d3ce-4505-b21b-3bbfac40d180" status: 200 len: 1364 microversion: 2.1 time: 0.226821 Jun 07 14:46:08.792267 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 339/667] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:46:08 2022] GET /compute/v2.1/servers/3636f852-d3ce-4505-b21b-3bbfac40d180 => generated 1364 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:46:09.810017 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-09d2fa34-34fc-4d63-898e-8a27a840d106 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:46:09.810727 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-09d2fa34-34fc-4d63-898e-8a27a840d106 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 3636f852-d3ce-4505-b21b-3bbfac40d180] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:46:09.818961 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-09d2fa34-34fc-4d63-898e-8a27a840d106 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:09.819425 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-09d2fa34-34fc-4d63-898e-8a27a840d106 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:09.820275 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-09d2fa34-34fc-4d63-898e-8a27a840d106 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:09.820739 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-09d2fa34-34fc-4d63-898e-8a27a840d106 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:09.948491 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-09d2fa34-34fc-4d63-898e-8a27a840d106 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eb9ec1f3ff44bbb03cf934cb2a04de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eae64ee53144e4f8d583bb4288c0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:46:09.956989 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-09d2fa34-34fc-4d63-898e-8a27a840d106 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/3636f852-d3ce-4505-b21b-3bbfac40d180" status: 200 len: 1364 microversion: 2.1 time: 0.151918 Jun 07 14:46:09.957744 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 329/668] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:46:09 2022] GET /compute/v2.1/servers/3636f852-d3ce-4505-b21b-3bbfac40d180 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:46:10.974709 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-c9bda58f-effe-450c-8691-e3e6d6a3a8f4 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:46:10.975328 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-c9bda58f-effe-450c-8691-e3e6d6a3a8f4 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 3636f852-d3ce-4505-b21b-3bbfac40d180] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:46:10.981330 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-c9bda58f-effe-450c-8691-e3e6d6a3a8f4 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:10.981778 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-c9bda58f-effe-450c-8691-e3e6d6a3a8f4 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:10.982535 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-c9bda58f-effe-450c-8691-e3e6d6a3a8f4 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:10.982977 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-c9bda58f-effe-450c-8691-e3e6d6a3a8f4 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:11.109215 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-c9bda58f-effe-450c-8691-e3e6d6a3a8f4 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eb9ec1f3ff44bbb03cf934cb2a04de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eae64ee53144e4f8d583bb4288c0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:46:11.117003 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-c9bda58f-effe-450c-8691-e3e6d6a3a8f4 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/3636f852-d3ce-4505-b21b-3bbfac40d180" status: 200 len: 1364 microversion: 2.1 time: 0.147249 Jun 07 14:46:11.117557 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 340/669] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:46:10 2022] GET /compute/v2.1/servers/3636f852-d3ce-4505-b21b-3bbfac40d180 => generated 1364 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:46:12.134191 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-1b581a76-c06f-4426-af80-015f6154a02d tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:46:12.134727 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-1b581a76-c06f-4426-af80-015f6154a02d tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 3636f852-d3ce-4505-b21b-3bbfac40d180] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:46:12.143569 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-1b581a76-c06f-4426-af80-015f6154a02d tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:12.144016 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-1b581a76-c06f-4426-af80-015f6154a02d tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:12.144813 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-1b581a76-c06f-4426-af80-015f6154a02d tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:12.145247 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-1b581a76-c06f-4426-af80-015f6154a02d tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:12.274399 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-1b581a76-c06f-4426-af80-015f6154a02d tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eb9ec1f3ff44bbb03cf934cb2a04de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eae64ee53144e4f8d583bb4288c0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:46:12.281750 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-1b581a76-c06f-4426-af80-015f6154a02d tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/3636f852-d3ce-4505-b21b-3bbfac40d180" status: 200 len: 1364 microversion: 2.1 time: 0.151872 Jun 07 14:46:12.282956 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 330/670] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:46:12 2022] GET /compute/v2.1/servers/3636f852-d3ce-4505-b21b-3bbfac40d180 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:46:13.299549 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-8909f15e-3bb8-4dda-a099-13e39ac7aeb9 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:46:13.300071 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-8909f15e-3bb8-4dda-a099-13e39ac7aeb9 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 3636f852-d3ce-4505-b21b-3bbfac40d180] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:46:13.306593 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-8909f15e-3bb8-4dda-a099-13e39ac7aeb9 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:13.307042 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-8909f15e-3bb8-4dda-a099-13e39ac7aeb9 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:13.307803 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-8909f15e-3bb8-4dda-a099-13e39ac7aeb9 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:13.308238 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-8909f15e-3bb8-4dda-a099-13e39ac7aeb9 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:13.455680 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-8909f15e-3bb8-4dda-a099-13e39ac7aeb9 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eb9ec1f3ff44bbb03cf934cb2a04de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eae64ee53144e4f8d583bb4288c0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:46:13.463649 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-8909f15e-3bb8-4dda-a099-13e39ac7aeb9 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/3636f852-d3ce-4505-b21b-3bbfac40d180" status: 200 len: 1364 microversion: 2.1 time: 0.168465 Jun 07 14:46:13.464233 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 341/671] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:46:13 2022] GET /compute/v2.1/servers/3636f852-d3ce-4505-b21b-3bbfac40d180 => generated 1364 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:46:14.483935 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-43310576-8931-495d-9854-7202103791ce tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:46:14.484703 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-43310576-8931-495d-9854-7202103791ce tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 3636f852-d3ce-4505-b21b-3bbfac40d180] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:46:14.487841 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG dbcounter [-] [118157] Writing DB stats nova_cell0:SELECT=6 {{(pid=118157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:46:14.492682 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-43310576-8931-495d-9854-7202103791ce tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:14.493211 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-43310576-8931-495d-9854-7202103791ce tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:14.494042 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-43310576-8931-495d-9854-7202103791ce tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:14.494474 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-43310576-8931-495d-9854-7202103791ce tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:14.624062 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-43310576-8931-495d-9854-7202103791ce tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eb9ec1f3ff44bbb03cf934cb2a04de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eae64ee53144e4f8d583bb4288c0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:46:14.631582 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-43310576-8931-495d-9854-7202103791ce tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/3636f852-d3ce-4505-b21b-3bbfac40d180" status: 200 len: 1364 microversion: 2.1 time: 0.151407 Jun 07 14:46:14.632134 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 331/672] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:46:14 2022] GET /compute/v2.1/servers/3636f852-d3ce-4505-b21b-3bbfac40d180 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:46:15.648787 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-13c73f7e-6143-4cbd-9273-bb11e3e9dd48 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:46:15.649391 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-13c73f7e-6143-4cbd-9273-bb11e3e9dd48 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 3636f852-d3ce-4505-b21b-3bbfac40d180] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:46:15.651258 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG dbcounter [-] [118158] Writing DB stats nova_cell0:SELECT=2 {{(pid=118158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:46:15.651911 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG dbcounter [-] [118158] Writing DB stats nova_cell0:SELECT=6 {{(pid=118158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:46:15.658032 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-13c73f7e-6143-4cbd-9273-bb11e3e9dd48 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:15.658422 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-13c73f7e-6143-4cbd-9273-bb11e3e9dd48 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:15.659185 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-13c73f7e-6143-4cbd-9273-bb11e3e9dd48 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:15.659609 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-13c73f7e-6143-4cbd-9273-bb11e3e9dd48 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:15.762416 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [req-876d4c64-2ead-4ede-b2e0-7602df0ccba9 req-f00f0aec-8f5b-42a2-a1db-49743bd97765 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3636f852-d3ce-4505-b21b-3bbfac40d180", "name": "network-vif-plugged", "status": "completed", "tag": "c503c043-18ef-4c10-a0e7-591b3c3fc023"}]} {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:46:15.773702 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [req-876d4c64-2ead-4ede-b2e0-7602df0ccba9 req-f00f0aec-8f5b-42a2-a1db-49743bd97765 service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:15.774216 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [req-876d4c64-2ead-4ede-b2e0-7602df0ccba9 req-f00f0aec-8f5b-42a2-a1db-49743bd97765 service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:15.787014 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.compute.server_external_events [req-876d4c64-2ead-4ede-b2e0-7602df0ccba9 req-f00f0aec-8f5b-42a2-a1db-49743bd97765 service nova] Creating event network-vif-plugged:c503c043-18ef-4c10-a0e7-591b3c3fc023 for instance 3636f852-d3ce-4505-b21b-3bbfac40d180 on hv-cinder-84497 Jun 07 14:46:15.792190 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [req-876d4c64-2ead-4ede-b2e0-7602df0ccba9 req-f00f0aec-8f5b-42a2-a1db-49743bd97765 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033952 Jun 07 14:46:15.794541 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 332/673] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jun 7 14:46:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 14:46:15.803529 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-13c73f7e-6143-4cbd-9273-bb11e3e9dd48 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eb9ec1f3ff44bbb03cf934cb2a04de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eae64ee53144e4f8d583bb4288c0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:46:15.812841 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-13c73f7e-6143-4cbd-9273-bb11e3e9dd48 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/3636f852-d3ce-4505-b21b-3bbfac40d180" status: 200 len: 1364 microversion: 2.1 time: 0.168064 Jun 07 14:46:15.814135 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 342/674] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:46:15 2022] GET /compute/v2.1/servers/3636f852-d3ce-4505-b21b-3bbfac40d180 => generated 1364 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:46:16.830881 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-1b6a120d-d387-44b2-9892-e1751a3ab577 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:46:16.832273 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-1b6a120d-d387-44b2-9892-e1751a3ab577 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 3636f852-d3ce-4505-b21b-3bbfac40d180] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:46:16.839086 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-1b6a120d-d387-44b2-9892-e1751a3ab577 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:16.839539 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-1b6a120d-d387-44b2-9892-e1751a3ab577 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:16.840308 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-1b6a120d-d387-44b2-9892-e1751a3ab577 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:16.840772 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-1b6a120d-d387-44b2-9892-e1751a3ab577 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:16.971426 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-1b6a120d-d387-44b2-9892-e1751a3ab577 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eb9ec1f3ff44bbb03cf934cb2a04de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eae64ee53144e4f8d583bb4288c0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:46:16.978772 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-1b6a120d-d387-44b2-9892-e1751a3ab577 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/3636f852-d3ce-4505-b21b-3bbfac40d180" status: 200 len: 1364 microversion: 2.1 time: 0.152066 Jun 07 14:46:16.979328 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 333/675] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:46:16 2022] GET /compute/v2.1/servers/3636f852-d3ce-4505-b21b-3bbfac40d180 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:46:17.995918 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-925a420b-31f0-4253-b9b8-f6e93e546dd8 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:46:17.996566 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-925a420b-31f0-4253-b9b8-f6e93e546dd8 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 3636f852-d3ce-4505-b21b-3bbfac40d180] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:46:18.003415 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-925a420b-31f0-4253-b9b8-f6e93e546dd8 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:18.003868 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-925a420b-31f0-4253-b9b8-f6e93e546dd8 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:18.004673 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-925a420b-31f0-4253-b9b8-f6e93e546dd8 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:18.005112 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-925a420b-31f0-4253-b9b8-f6e93e546dd8 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:18.175182 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-925a420b-31f0-4253-b9b8-f6e93e546dd8 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eb9ec1f3ff44bbb03cf934cb2a04de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eae64ee53144e4f8d583bb4288c0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:46:18.179175 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG dbcounter [-] [118158] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:46:18.185428 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-925a420b-31f0-4253-b9b8-f6e93e546dd8 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/3636f852-d3ce-4505-b21b-3bbfac40d180" status: 200 len: 1553 microversion: 2.1 time: 0.193272 Jun 07 14:46:18.186505 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 343/676] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:46:17 2022] GET /compute/v2.1/servers/3636f852-d3ce-4505-b21b-3bbfac40d180 => generated 1553 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:46:18.203311 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-c3260a39-7472-4d20-a7e2-b06b9296baf1 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:46:18.204794 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-c3260a39-7472-4d20-a7e2-b06b9296baf1 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 3636f852-d3ce-4505-b21b-3bbfac40d180] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:46:18.211376 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-c3260a39-7472-4d20-a7e2-b06b9296baf1 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:18.211818 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-c3260a39-7472-4d20-a7e2-b06b9296baf1 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:18.212682 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-c3260a39-7472-4d20-a7e2-b06b9296baf1 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:18.213119 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-c3260a39-7472-4d20-a7e2-b06b9296baf1 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:18.290943 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-c3260a39-7472-4d20-a7e2-b06b9296baf1 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/3636f852-d3ce-4505-b21b-3bbfac40d180/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091585 Jun 07 14:46:18.291529 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 334/677] 10.222.0.85 () {58 vars in 1274 bytes} [Tue Jun 7 14:46:18 2022] GET /compute/v2.1/servers/3636f852-d3ce-4505-b21b-3bbfac40d180/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:46:19.385116 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [req-d0c5e89a-e360-475f-84e2-202852f55fea req-cd994782-4093-4c29-9e02-e8d22fbda78b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3636f852-d3ce-4505-b21b-3bbfac40d180", "tag": "c503c043-18ef-4c10-a0e7-591b3c3fc023"}]} {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:46:19.393706 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [req-d0c5e89a-e360-475f-84e2-202852f55fea req-cd994782-4093-4c29-9e02-e8d22fbda78b service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:19.394233 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [req-d0c5e89a-e360-475f-84e2-202852f55fea req-cd994782-4093-4c29-9e02-e8d22fbda78b service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:19.405599 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.compute.server_external_events [req-d0c5e89a-e360-475f-84e2-202852f55fea req-cd994782-4093-4c29-9e02-e8d22fbda78b service nova] Creating event network-changed:c503c043-18ef-4c10-a0e7-591b3c3fc023 for instance 3636f852-d3ce-4505-b21b-3bbfac40d180 on hv-cinder-84497 Jun 07 14:46:19.411267 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [req-d0c5e89a-e360-475f-84e2-202852f55fea req-cd994782-4093-4c29-9e02-e8d22fbda78b service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.151787 Jun 07 14:46:19.411934 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 344/678] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jun 7 14:46:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:46:30.755223 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG dbcounter [-] [118157] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=118157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:46:30.755975 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG dbcounter [-] [118157] Writing DB stats nova_cell1:SELECT=64 {{(pid=118157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:46:30.873916 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-04865732-7129-44c5-a875-9cb84de58cc4 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:46:30.874423 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-04865732-7129-44c5-a875-9cb84de58cc4 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:46:30.883235 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-04865732-7129-44c5-a875-9cb84de58cc4 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:30.883826 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-04865732-7129-44c5-a875-9cb84de58cc4 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:30.885082 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-04865732-7129-44c5-a875-9cb84de58cc4 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:30.885749 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-04865732-7129-44c5-a875-9cb84de58cc4 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:30.914929 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-04865732-7129-44c5-a875-9cb84de58cc4 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089/os-volume_attachments/cebcf912-00bf-4af0-a6cf-cc4893a5b893" status: 200 len: 194 microversion: 2.20 time: 0.161255 Jun 07 14:46:30.915474 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 335/679] 10.222.0.85 () {60 vars in 1453 bytes} [Tue Jun 7 14:46:30 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089/os-volume_attachments/cebcf912-00bf-4af0-a6cf-cc4893a5b893 => generated 194 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 14:46:30.977094 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG dbcounter [-] [118158] Writing DB stats nova_api:SELECT=15 {{(pid=118158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:46:30.979664 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG dbcounter [-] [118158] Writing DB stats nova_cell1:SELECT=3 {{(pid=118158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:46:30.984086 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-1b19e81f-686f-4cf2-84bd-3a81b315701b tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:46:30.988318 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-1b19e81f-686f-4cf2-84bd-3a81b315701b tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:46:30.991413 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-1b19e81f-686f-4cf2-84bd-3a81b315701b tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:30.991869 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-1b19e81f-686f-4cf2-84bd-3a81b315701b tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:30.992694 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-1b19e81f-686f-4cf2-84bd-3a81b315701b tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:30.993137 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-1b19e81f-686f-4cf2-84bd-3a81b315701b tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:31.082114 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.objects.instance [None req-1b19e81f-686f-4cf2-84bd-3a81b315701b tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lazy-loading 'services' on Instance uuid a8a8352c-4f05-4640-a976-edb025819089 {{(pid=118158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 14:46:31.277329 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-1b19e81f-686f-4cf2-84bd-3a81b315701b tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "DELETE /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089/os-volume_attachments/cebcf912-00bf-4af0-a6cf-cc4893a5b893" status: 202 len: 0 microversion: 2.20 time: 0.301647 Jun 07 14:46:31.278006 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 345/680] 10.222.0.85 () {60 vars in 1456 bytes} [Tue Jun 7 14:46:30 2022] DELETE /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089/os-volume_attachments/cebcf912-00bf-4af0-a6cf-cc4893a5b893 => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 07 14:46:31.287282 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-12a792be-dfc0-4e2b-ab63-309e2bb12058 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:46:31.288285 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-12a792be-dfc0-4e2b-ab63-309e2bb12058 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:46:31.294436 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-12a792be-dfc0-4e2b-ab63-309e2bb12058 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:31.294897 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-12a792be-dfc0-4e2b-ab63-309e2bb12058 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:31.295659 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-12a792be-dfc0-4e2b-ab63-309e2bb12058 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:31.296100 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-12a792be-dfc0-4e2b-ab63-309e2bb12058 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:31.328263 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-12a792be-dfc0-4e2b-ab63-309e2bb12058 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045582 Jun 07 14:46:31.328876 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 336/681] 10.222.0.85 () {60 vars in 1342 bytes} [Tue Jun 7 14:46:31 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 07 14:46:32.341767 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-930bedb3-2165-4dba-958a-fdd591260c85 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:46:32.342831 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-930bedb3-2165-4dba-958a-fdd591260c85 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:46:32.349746 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-930bedb3-2165-4dba-958a-fdd591260c85 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:32.350195 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-930bedb3-2165-4dba-958a-fdd591260c85 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:32.350964 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-930bedb3-2165-4dba-958a-fdd591260c85 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:32.351445 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-930bedb3-2165-4dba-958a-fdd591260c85 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:32.381884 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-930bedb3-2165-4dba-958a-fdd591260c85 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044964 Jun 07 14:46:32.382436 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 346/682] 10.222.0.85 () {60 vars in 1342 bytes} [Tue Jun 7 14:46:32 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 14:46:32.860558 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-b9d43264-e38f-460a-8a11-8775f8cbf38e tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:46:32.861074 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-b9d43264-e38f-460a-8a11-8775f8cbf38e tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 7dec201c-634b-4b93-bc30-0ac8e60795c7] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:46:32.868205 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-b9d43264-e38f-460a-8a11-8775f8cbf38e tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:32.868692 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-b9d43264-e38f-460a-8a11-8775f8cbf38e tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:32.869467 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-b9d43264-e38f-460a-8a11-8775f8cbf38e tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:32.869907 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-b9d43264-e38f-460a-8a11-8775f8cbf38e tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:32.951527 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.objects.instance [None req-b9d43264-e38f-460a-8a11-8775f8cbf38e tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lazy-loading 'services' on Instance uuid 7dec201c-634b-4b93-bc30-0ac8e60795c7 {{(pid=118157) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 14:46:33.174134 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-b9d43264-e38f-460a-8a11-8775f8cbf38e tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "DELETE /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7/os-volume_attachments/a64e513d-aa73-4193-b8d4-e946bc9063ac" status: 202 len: 0 microversion: 2.1 time: 0.317271 Jun 07 14:46:33.174719 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 337/683] 10.222.0.85 () {58 vars in 1415 bytes} [Tue Jun 7 14:46:32 2022] DELETE /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7/os-volume_attachments/a64e513d-aa73-4193-b8d4-e946bc9063ac => generated 0 bytes in 319 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 14:46:33.183098 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-954e0ab3-012d-4562-9e24-c5296c98a9c4 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:46:33.184142 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-954e0ab3-012d-4562-9e24-c5296c98a9c4 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 7dec201c-634b-4b93-bc30-0ac8e60795c7] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:46:33.191011 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-954e0ab3-012d-4562-9e24-c5296c98a9c4 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:33.191446 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-954e0ab3-012d-4562-9e24-c5296c98a9c4 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:33.192225 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-954e0ab3-012d-4562-9e24-c5296c98a9c4 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:33.192701 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-954e0ab3-012d-4562-9e24-c5296c98a9c4 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:33.221776 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-954e0ab3-012d-4562-9e24-c5296c98a9c4 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042629 Jun 07 14:46:33.222327 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 347/684] 10.222.0.85 () {58 vars in 1301 bytes} [Tue Jun 7 14:46:33 2022] GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:46:33.394282 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-18c2c62b-3c62-4d51-9e6f-44919391bbf4 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:46:33.395352 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-18c2c62b-3c62-4d51-9e6f-44919391bbf4 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:46:33.402144 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-18c2c62b-3c62-4d51-9e6f-44919391bbf4 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:33.402599 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-18c2c62b-3c62-4d51-9e6f-44919391bbf4 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:33.403376 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-18c2c62b-3c62-4d51-9e6f-44919391bbf4 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:33.403812 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-18c2c62b-3c62-4d51-9e6f-44919391bbf4 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:33.434789 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-18c2c62b-3c62-4d51-9e6f-44919391bbf4 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044770 Jun 07 14:46:33.435365 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 338/685] 10.222.0.85 () {60 vars in 1342 bytes} [Tue Jun 7 14:46:33 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:46:33.495250 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-39b1e90d-767c-4007-b65d-6014e17efda0 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:46:33.501495 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-39b1e90d-767c-4007-b65d-6014e17efda0 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:46:33.502281 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-39b1e90d-767c-4007-b65d-6014e17efda0 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:33.502733 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-39b1e90d-767c-4007-b65d-6014e17efda0 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:33.503499 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-39b1e90d-767c-4007-b65d-6014e17efda0 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:33.503933 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-39b1e90d-767c-4007-b65d-6014e17efda0 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:33.529898 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-39b1e90d-767c-4007-b65d-6014e17efda0 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Going to try to terminate instance {{(pid=118158) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 14:46:33.826292 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-39b1e90d-767c-4007-b65d-6014e17efda0 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "DELETE /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 204 len: 0 microversion: 2.20 time: 0.334601 Jun 07 14:46:33.826888 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 348/686] 10.222.0.85 () {60 vars in 1279 bytes} [Tue Jun 7 14:46:33 2022] DELETE /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 07 14:46:33.835034 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-4a6aea2d-edc8-4fc7-b27c-d6b0fab50e4a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:46:33.835730 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-4a6aea2d-edc8-4fc7-b27c-d6b0fab50e4a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:46:33.841754 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-4a6aea2d-edc8-4fc7-b27c-d6b0fab50e4a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:33.842210 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-4a6aea2d-edc8-4fc7-b27c-d6b0fab50e4a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:33.842971 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-4a6aea2d-edc8-4fc7-b27c-d6b0fab50e4a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:33.843402 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-4a6aea2d-edc8-4fc7-b27c-d6b0fab50e4a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:33.980742 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-4a6aea2d-edc8-4fc7-b27c-d6b0fab50e4a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:46:33.990850 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-4a6aea2d-edc8-4fc7-b27c-d6b0fab50e4a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:46:33.992335 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-4a6aea2d-edc8-4fc7-b27c-d6b0fab50e4a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:46:33.993511 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-4a6aea2d-edc8-4fc7-b27c-d6b0fab50e4a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1724 microversion: 2.20 time: 0.162436 Jun 07 14:46:33.994060 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 339/687] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:46:33 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:46:34.234139 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-43b85b85-f20d-4b89-ac7c-49be6440373a tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:46:34.235277 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-43b85b85-f20d-4b89-ac7c-49be6440373a tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 7dec201c-634b-4b93-bc30-0ac8e60795c7] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:46:34.241877 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-43b85b85-f20d-4b89-ac7c-49be6440373a tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:34.242330 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-43b85b85-f20d-4b89-ac7c-49be6440373a tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:34.243090 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-43b85b85-f20d-4b89-ac7c-49be6440373a tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:34.243526 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-43b85b85-f20d-4b89-ac7c-49be6440373a tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:34.272593 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-43b85b85-f20d-4b89-ac7c-49be6440373a tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042687 Jun 07 14:46:34.273914 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 349/688] 10.222.0.85 () {58 vars in 1301 bytes} [Tue Jun 7 14:46:34 2022] GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:46:35.012962 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-d9177717-f48b-4403-b9cf-df1e85580654 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:46:35.013623 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-d9177717-f48b-4403-b9cf-df1e85580654 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:46:35.020282 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-d9177717-f48b-4403-b9cf-df1e85580654 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:35.020769 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-d9177717-f48b-4403-b9cf-df1e85580654 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:35.021811 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-d9177717-f48b-4403-b9cf-df1e85580654 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:35.022291 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-d9177717-f48b-4403-b9cf-df1e85580654 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:35.158350 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-d9177717-f48b-4403-b9cf-df1e85580654 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:46:35.166282 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-d9177717-f48b-4403-b9cf-df1e85580654 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:46:35.167766 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-d9177717-f48b-4403-b9cf-df1e85580654 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:46:35.168998 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-d9177717-f48b-4403-b9cf-df1e85580654 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1724 microversion: 2.20 time: 0.159970 Jun 07 14:46:35.169549 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 340/689] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:46:35 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:46:35.283088 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-13d5e59f-8c46-4531-950c-c07455fd3c93 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:46:35.283988 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-13d5e59f-8c46-4531-950c-c07455fd3c93 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 7dec201c-634b-4b93-bc30-0ac8e60795c7] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:46:35.290419 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-13d5e59f-8c46-4531-950c-c07455fd3c93 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:35.290872 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-13d5e59f-8c46-4531-950c-c07455fd3c93 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:35.291644 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-13d5e59f-8c46-4531-950c-c07455fd3c93 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:35.292081 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-13d5e59f-8c46-4531-950c-c07455fd3c93 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:35.322195 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-13d5e59f-8c46-4531-950c-c07455fd3c93 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043052 Jun 07 14:46:35.322748 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 350/690] 10.222.0.85 () {58 vars in 1301 bytes} [Tue Jun 7 14:46:35 2022] GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:46:36.187040 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-b4b80a5c-906c-493c-9fb7-ee844290104b tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:46:36.187770 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-b4b80a5c-906c-493c-9fb7-ee844290104b tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:46:36.194347 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-b4b80a5c-906c-493c-9fb7-ee844290104b tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:36.194866 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-b4b80a5c-906c-493c-9fb7-ee844290104b tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:36.195637 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-b4b80a5c-906c-493c-9fb7-ee844290104b tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:36.196067 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-b4b80a5c-906c-493c-9fb7-ee844290104b tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:36.328724 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-b4b80a5c-906c-493c-9fb7-ee844290104b tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:46:36.334569 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-bf3f6679-c685-43b4-9f28-25c598818b25 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:46:36.336115 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-bf3f6679-c685-43b4-9f28-25c598818b25 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 7dec201c-634b-4b93-bc30-0ac8e60795c7] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:46:36.336839 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-b4b80a5c-906c-493c-9fb7-ee844290104b tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:46:36.338338 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-b4b80a5c-906c-493c-9fb7-ee844290104b tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:46:36.339497 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-b4b80a5c-906c-493c-9fb7-ee844290104b tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1724 microversion: 2.20 time: 0.156359 Jun 07 14:46:36.340044 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 341/691] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:46:36 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:46:36.342311 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-bf3f6679-c685-43b4-9f28-25c598818b25 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:36.342776 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-bf3f6679-c685-43b4-9f28-25c598818b25 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:36.343555 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-bf3f6679-c685-43b4-9f28-25c598818b25 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:36.343993 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-bf3f6679-c685-43b4-9f28-25c598818b25 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:36.372543 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-bf3f6679-c685-43b4-9f28-25c598818b25 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042623 Jun 07 14:46:36.373097 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 351/692] 10.222.0.85 () {58 vars in 1301 bytes} [Tue Jun 7 14:46:36 2022] GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 07 14:46:36.450790 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-c26e221c-a43c-4fba-be59-434123a51a6a tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:46:36.451271 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-c26e221c-a43c-4fba-be59-434123a51a6a tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 7dec201c-634b-4b93-bc30-0ac8e60795c7] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:46:36.458210 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-c26e221c-a43c-4fba-be59-434123a51a6a tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:36.458664 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-c26e221c-a43c-4fba-be59-434123a51a6a tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:36.459472 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-c26e221c-a43c-4fba-be59-434123a51a6a tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:36.459915 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-c26e221c-a43c-4fba-be59-434123a51a6a tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:36.485183 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-c26e221c-a43c-4fba-be59-434123a51a6a tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 7dec201c-634b-4b93-bc30-0ac8e60795c7] Going to try to terminate instance {{(pid=118157) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 14:46:36.782241 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-c26e221c-a43c-4fba-be59-434123a51a6a tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "DELETE /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7" status: 204 len: 0 microversion: 2.1 time: 0.334945 Jun 07 14:46:36.783900 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 342/693] 10.222.0.85 () {58 vars in 1238 bytes} [Tue Jun 7 14:46:36 2022] DELETE /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 14:46:36.791832 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-05c4e02f-c4a3-4212-93fc-fdb732625b84 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:46:36.792608 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-05c4e02f-c4a3-4212-93fc-fdb732625b84 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 7dec201c-634b-4b93-bc30-0ac8e60795c7] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:46:36.798509 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-05c4e02f-c4a3-4212-93fc-fdb732625b84 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:36.799805 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-05c4e02f-c4a3-4212-93fc-fdb732625b84 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:36.800268 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-05c4e02f-c4a3-4212-93fc-fdb732625b84 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:36.800742 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-05c4e02f-c4a3-4212-93fc-fdb732625b84 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:37.026887 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [req-db944581-19bb-481d-96da-38e464cb6b17 req-bb8c0326-546d-4181-829b-5f04dff33306 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8a8352c-4f05-4640-a976-edb025819089", "name": "network-vif-deleted", "tag": "557a43fa-c7ca-47d0-9a4b-fe35626e8941"}]} {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:46:37.029510 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-05c4e02f-c4a3-4212-93fc-fdb732625b84 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:46:37.040995 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [req-db944581-19bb-481d-96da-38e464cb6b17 req-bb8c0326-546d-4181-829b-5f04dff33306 service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:37.041443 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [req-db944581-19bb-481d-96da-38e464cb6b17 req-bb8c0326-546d-4181-829b-5f04dff33306 service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:37.043927 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-05c4e02f-c4a3-4212-93fc-fdb732625b84 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7" status: 200 len: 1688 microversion: 2.1 time: 0.255701 Jun 07 14:46:37.045094 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 352/694] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:46:36 2022] GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7 => generated 1688 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:46:37.053895 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.compute.server_external_events [req-db944581-19bb-481d-96da-38e464cb6b17 req-bb8c0326-546d-4181-829b-5f04dff33306 service nova] Creating event network-vif-deleted:557a43fa-c7ca-47d0-9a4b-fe35626e8941 for instance a8a8352c-4f05-4640-a976-edb025819089 on hv-cinder-84497 Jun 07 14:46:37.058993 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [req-db944581-19bb-481d-96da-38e464cb6b17 req-bb8c0326-546d-4181-829b-5f04dff33306 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039221 Jun 07 14:46:37.059959 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 343/695] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jun 7 14:46:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:46:37.358118 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-a44ec72e-8930-4708-af6c-b3504fcfe5b7 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:46:37.358732 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-a44ec72e-8930-4708-af6c-b3504fcfe5b7 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:46:37.365901 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-a44ec72e-8930-4708-af6c-b3504fcfe5b7 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:37.366351 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-a44ec72e-8930-4708-af6c-b3504fcfe5b7 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:37.367123 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-a44ec72e-8930-4708-af6c-b3504fcfe5b7 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:37.367562 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-a44ec72e-8930-4708-af6c-b3504fcfe5b7 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:37.437730 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-a44ec72e-8930-4708-af6c-b3504fcfe5b7 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:46:37.446794 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-a44ec72e-8930-4708-af6c-b3504fcfe5b7 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:46:37.448310 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-a44ec72e-8930-4708-af6c-b3504fcfe5b7 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:46:37.449576 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-a44ec72e-8930-4708-af6c-b3504fcfe5b7 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1656 microversion: 2.20 time: 0.095358 Jun 07 14:46:37.450142 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 353/696] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:46:37 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1656 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:46:38.073651 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-d3f4e3ca-ead3-4269-9f7b-8c6f4e69f2ca tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:46:38.074352 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-d3f4e3ca-ead3-4269-9f7b-8c6f4e69f2ca tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 7dec201c-634b-4b93-bc30-0ac8e60795c7] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:46:38.081315 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-d3f4e3ca-ead3-4269-9f7b-8c6f4e69f2ca tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:38.081766 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-d3f4e3ca-ead3-4269-9f7b-8c6f4e69f2ca tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:38.082533 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-d3f4e3ca-ead3-4269-9f7b-8c6f4e69f2ca tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:38.082966 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-d3f4e3ca-ead3-4269-9f7b-8c6f4e69f2ca tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:38.213913 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-d3f4e3ca-ead3-4269-9f7b-8c6f4e69f2ca tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:46:38.223077 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-d3f4e3ca-ead3-4269-9f7b-8c6f4e69f2ca tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7" status: 200 len: 1688 microversion: 2.1 time: 0.154229 Jun 07 14:46:38.223834 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 344/697] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:46:38 2022] GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7 => generated 1688 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:46:38.468774 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-7100eedc-0641-4f8a-9fb8-c9405bf06fa7 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:46:38.469410 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-7100eedc-0641-4f8a-9fb8-c9405bf06fa7 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:46:38.475856 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-7100eedc-0641-4f8a-9fb8-c9405bf06fa7 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:38.476303 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-7100eedc-0641-4f8a-9fb8-c9405bf06fa7 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:38.477109 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-7100eedc-0641-4f8a-9fb8-c9405bf06fa7 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:38.477549 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-7100eedc-0641-4f8a-9fb8-c9405bf06fa7 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:38.540644 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-7100eedc-0641-4f8a-9fb8-c9405bf06fa7 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:46:38.548685 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-7100eedc-0641-4f8a-9fb8-c9405bf06fa7 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:46:38.550753 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-7100eedc-0641-4f8a-9fb8-c9405bf06fa7 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:46:38.551422 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-7100eedc-0641-4f8a-9fb8-c9405bf06fa7 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1656 microversion: 2.20 time: 0.086565 Jun 07 14:46:38.551975 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 354/698] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:46:38 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1656 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 14:46:39.241715 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-8ad9ac90-16c7-49a9-9b8f-24138d0ff14b tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:46:39.242270 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-8ad9ac90-16c7-49a9-9b8f-24138d0ff14b tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 7dec201c-634b-4b93-bc30-0ac8e60795c7] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:46:39.248184 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-8ad9ac90-16c7-49a9-9b8f-24138d0ff14b tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:39.248679 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-8ad9ac90-16c7-49a9-9b8f-24138d0ff14b tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:39.249449 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-8ad9ac90-16c7-49a9-9b8f-24138d0ff14b tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:39.249887 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-8ad9ac90-16c7-49a9-9b8f-24138d0ff14b tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:39.405355 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-8ad9ac90-16c7-49a9-9b8f-24138d0ff14b tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:46:39.412857 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-8ad9ac90-16c7-49a9-9b8f-24138d0ff14b tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7" status: 200 len: 1688 microversion: 2.1 time: 0.176056 Jun 07 14:46:39.413412 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 345/699] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:46:39 2022] GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7 => generated 1688 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:46:39.570777 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-7a4f106d-c9c5-4a58-9c43-088518eb63ef tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:46:39.571337 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-7a4f106d-c9c5-4a58-9c43-088518eb63ef tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:46:39.578067 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-7a4f106d-c9c5-4a58-9c43-088518eb63ef tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:39.578513 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-7a4f106d-c9c5-4a58-9c43-088518eb63ef tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:39.579281 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-7a4f106d-c9c5-4a58-9c43-088518eb63ef tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:39.579710 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-7a4f106d-c9c5-4a58-9c43-088518eb63ef tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:39.648160 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-7a4f106d-c9c5-4a58-9c43-088518eb63ef tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:46:39.656648 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-7a4f106d-c9c5-4a58-9c43-088518eb63ef tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:46:39.658800 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-7a4f106d-c9c5-4a58-9c43-088518eb63ef tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:46:39.659982 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-7a4f106d-c9c5-4a58-9c43-088518eb63ef tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1656 microversion: 2.20 time: 0.093283 Jun 07 14:46:39.660577 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 355/700] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:46:39 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1656 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:46:40.433092 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-fca4f303-2961-462a-841c-eeed9a7190fa tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:46:40.434106 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-fca4f303-2961-462a-841c-eeed9a7190fa tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 7dec201c-634b-4b93-bc30-0ac8e60795c7] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:46:40.441760 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-fca4f303-2961-462a-841c-eeed9a7190fa tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:40.442201 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-fca4f303-2961-462a-841c-eeed9a7190fa tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:40.442977 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-fca4f303-2961-462a-841c-eeed9a7190fa tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:40.443409 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-fca4f303-2961-462a-841c-eeed9a7190fa tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:40.601036 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-fca4f303-2961-462a-841c-eeed9a7190fa tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:46:40.608706 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-fca4f303-2961-462a-841c-eeed9a7190fa tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7" status: 200 len: 1688 microversion: 2.1 time: 0.181618 Jun 07 14:46:40.610501 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 346/701] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:46:40 2022] GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7 => generated 1688 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:46:40.679551 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-df05847a-fd09-4851-a3b5-e2eb49962c28 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:46:40.680240 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-df05847a-fd09-4851-a3b5-e2eb49962c28 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:46:40.688328 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-df05847a-fd09-4851-a3b5-e2eb49962c28 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:40.688328 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-df05847a-fd09-4851-a3b5-e2eb49962c28 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:40.688328 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-df05847a-fd09-4851-a3b5-e2eb49962c28 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:40.688328 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-df05847a-fd09-4851-a3b5-e2eb49962c28 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:40.723568 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-df05847a-fd09-4851-a3b5-e2eb49962c28 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:40.724017 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-df05847a-fd09-4851-a3b5-e2eb49962c28 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:40.724499 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.objects.instance [None req-df05847a-fd09-4851-a3b5-e2eb49962c28 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lazy-loading 'fault' on Instance uuid a8a8352c-4f05-4640-a976-edb025819089 {{(pid=118158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 14:46:40.770888 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-df05847a-fd09-4851-a3b5-e2eb49962c28 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:46:40.779317 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-df05847a-fd09-4851-a3b5-e2eb49962c28 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:46:40.780965 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-df05847a-fd09-4851-a3b5-e2eb49962c28 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:46:40.782404 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-df05847a-fd09-4851-a3b5-e2eb49962c28 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 200 len: 1372 microversion: 2.20 time: 0.107425 Jun 07 14:46:40.782993 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 356/702] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:46:40 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 1372 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:46:41.626099 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-f1d627ee-ee49-4cc5-a735-c7a3e41e993f tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:46:41.626623 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-f1d627ee-ee49-4cc5-a735-c7a3e41e993f tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 7dec201c-634b-4b93-bc30-0ac8e60795c7] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:46:41.634029 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-f1d627ee-ee49-4cc5-a735-c7a3e41e993f tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:41.635452 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-f1d627ee-ee49-4cc5-a735-c7a3e41e993f tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:41.635452 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-f1d627ee-ee49-4cc5-a735-c7a3e41e993f tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:41.636126 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-f1d627ee-ee49-4cc5-a735-c7a3e41e993f tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:41.805827 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-67b6fcf6-0fc3-45ab-bdac-cceb6e05036f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:46:41.806452 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-67b6fcf6-0fc3-45ab-bdac-cceb6e05036f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:46:41.813591 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-67b6fcf6-0fc3-45ab-bdac-cceb6e05036f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:41.814095 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-67b6fcf6-0fc3-45ab-bdac-cceb6e05036f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:41.815492 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-67b6fcf6-0fc3-45ab-bdac-cceb6e05036f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:41.816175 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-67b6fcf6-0fc3-45ab-bdac-cceb6e05036f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:41.832366 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.wsgi [None req-67b6fcf6-0fc3-45ab-bdac-cceb6e05036f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] HTTP exception thrown: Instance a8a8352c-4f05-4640-a976-edb025819089 could not be found. Jun 07 14:46:41.834419 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-67b6fcf6-0fc3-45ab-bdac-cceb6e05036f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Request method failure captured: Jun 07 14:46:41.834419 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: request: GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 HTTP/1.1 Jun 07 14:46:41.834419 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Accept: application/json Jun 07 14:46:41.834419 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Accept-Encoding: identity Jun 07 14:46:41.834419 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Connection: close Jun 07 14:46:41.834419 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Content-Length: 0 Jun 07 14:46:41.834419 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Content-Type: application/json Jun 07 14:46:41.834419 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Host: 10.222.0.85 Jun 07 14:46:41.834419 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Openstack-System-Scope: None Jun 07 14:46:41.834419 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: User-Agent: python-urllib3/1.26.9 Jun 07 14:46:41.834419 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Auth-Token: gAAAAABin2N4eg8ljLkujTllXmla-f9Utwkro_n2NGvX66R0WQ3VhG9X255DHwF93uP2eLCGyu4YzGgS25vgqUptMxS_YvCNFIrvRsHolae3yVnlb5rJduKT46NpWaBuq7E5pf08GFOQq58grSyxOEnc51TMZmGRHSL2y5vODYb6A4UfzXPec-g Jun 07 14:46:41.834419 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Domain-Id: None Jun 07 14:46:41.834419 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Domain-Name: None Jun 07 14:46:41.834419 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Identity-Status: Confirmed Jun 07 14:46:41.834419 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Is-Admin-Project: True Jun 07 14:46:41.834419 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Openstack-Nova-Api-Version: 2.20 Jun 07 14:46:41.834419 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Domain-Id: default Jun 07 14:46:41.834419 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Domain-Name: Default Jun 07 14:46:41.834419 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Id: 6714e8cfaee34ac3af916af5e4bb1031 Jun 07 14:46:41.834419 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-550906303 Jun 07 14:46:41.834419 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Role: member,reader Jun 07 14:46:41.834419 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Roles: member,reader Jun 07 14:46:41.835785 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/6714e8cfaee34ac3af916af5e4bb1031"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_6714e8cfaee34ac3af916af5e4bb1031"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/6714e8cfaee34ac3af916af5e4bb1031"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/6714e8cfaee34ac3af916af5e4bb1031"}]}] Jun 07 14:46:41.835785 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Tenant: tempest-AttachVolumeShelveTestJSON-550906303 Jun 07 14:46:41.835785 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Tenant-Id: 6714e8cfaee34ac3af916af5e4bb1031 Jun 07 14:46:41.835785 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-550906303 Jun 07 14:46:41.835785 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User: tempest-AttachVolumeShelveTestJSON-550906303-project Jun 07 14:46:41.835785 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Domain-Id: default Jun 07 14:46:41.835785 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Domain-Name: Default Jun 07 14:46:41.835785 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Id: ed3353d3d8a242e1a6b54d31adf97a6d Jun 07 14:46:41.835785 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Name: tempest-AttachVolumeShelveTestJSON-550906303-project Jun 07 14:46:41.835785 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: method: > Jun 07 14:46:41.835785 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: exception: Instance a8a8352c-4f05-4640-a976-edb025819089 could not be found. Jun 07 14:46:41.835785 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: action_args: {'id': 'a8a8352c-4f05-4640-a976-edb025819089'} Jun 07 14:46:41.836697 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:46:41.836697 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:46:41.836697 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 14:46:41.836697 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 14:46:41.836697 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 14:46:41.836697 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 14:46:41.836697 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 14:46:41.836697 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 14:46:41.836697 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 14:46:41.836697 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 14:46:41.836697 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8a8352c-4f05-4640-a976-edb025819089 could not be found. Jun 07 14:46:41.836697 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:46:41.836697 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:46:41.836697 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:46:41.836697 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:46:41.836697 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:46:41.836697 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:46:41.836697 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:46:41.836697 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:46:41.836697 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:46:41.838678 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:46:41.838678 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 14:46:41.838678 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 14:46:41.838678 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 14:46:41.838678 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 14:46:41.838678 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 14:46:41.838678 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:46:41.838678 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8a8352c-4f05-4640-a976-edb025819089 could not be found. Jun 07 14:46:41.838678 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:46:41.838678 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:46:41.838678 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:46:41.838678 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:46:41.838678 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:46:41.838678 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:46:41.838678 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:46:41.838678 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:46:41.838678 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8a8352c-4f05-4640-a976-edb025819089 could not be found. Jun 07 14:46:41.838678 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:46:41.839758 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-67b6fcf6-0fc3-45ab-bdac-cceb6e05036f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Returning 404 to user: Instance a8a8352c-4f05-4640-a976-edb025819089 could not be found. {{(pid=118158) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:46:41.839758 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-67b6fcf6-0fc3-45ab-bdac-cceb6e05036f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 404 len: 111 microversion: 2.20 time: 0.034934 Jun 07 14:46:41.839758 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 357/703] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:46:41 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 07 14:46:41.848959 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-0a9eb0ad-1930-4b67-b35c-f868979314a2 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '.version_select at 0x7f5f827d6af0>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:46:41.866545 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-f1d627ee-ee49-4cc5-a735-c7a3e41e993f tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:46:41.882418 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-f1d627ee-ee49-4cc5-a735-c7a3e41e993f tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7" status: 200 len: 1620 microversion: 2.1 time: 0.254702 Jun 07 14:46:41.882418 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 347/704] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:46:41 2022] GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7 => generated 1620 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:46:41.938687 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-0a9eb0ad-1930-4b67-b35c-f868979314a2 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2113095407" status: 204 len: 0 microversion: 2.20 time: 0.095617 Jun 07 14:46:41.939748 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 358/705] 10.222.0.85 () {60 vars in 1261 bytes} [Tue Jun 7 14:46:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2113095407 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 07 14:46:42.093599 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [req-fd5a4c26-41fe-4fed-bcea-4bddcd08ffa2 req-cd2b30c3-bdd8-46fe-961c-4a4e788e7c6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dec201c-634b-4b93-bc30-0ac8e60795c7", "name": "network-vif-deleted", "tag": "c9370c3f-495d-4859-9ac6-25184d933583"}]} {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:46:42.108582 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [req-fd5a4c26-41fe-4fed-bcea-4bddcd08ffa2 req-cd2b30c3-bdd8-46fe-961c-4a4e788e7c6c service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:42.110030 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [req-fd5a4c26-41fe-4fed-bcea-4bddcd08ffa2 req-cd2b30c3-bdd8-46fe-961c-4a4e788e7c6c service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:42.128603 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.compute.server_external_events [req-fd5a4c26-41fe-4fed-bcea-4bddcd08ffa2 req-cd2b30c3-bdd8-46fe-961c-4a4e788e7c6c service nova] Creating event network-vif-deleted:c9370c3f-495d-4859-9ac6-25184d933583 for instance 7dec201c-634b-4b93-bc30-0ac8e60795c7 on hv-cinder-84497 Jun 07 14:46:42.137147 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [req-fd5a4c26-41fe-4fed-bcea-4bddcd08ffa2 req-cd2b30c3-bdd8-46fe-961c-4a4e788e7c6c service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049204 Jun 07 14:46:42.139087 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 348/706] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jun 7 14:46:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:46:42.901408 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-8a2565f6-9d25-4e55-b672-82ea8e5482db tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:46:42.902333 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-8a2565f6-9d25-4e55-b672-82ea8e5482db tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 7dec201c-634b-4b93-bc30-0ac8e60795c7] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:46:42.918003 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-8a2565f6-9d25-4e55-b672-82ea8e5482db tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:42.918457 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-8a2565f6-9d25-4e55-b672-82ea8e5482db tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:42.919241 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-8a2565f6-9d25-4e55-b672-82ea8e5482db tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:42.919681 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-8a2565f6-9d25-4e55-b672-82ea8e5482db tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:42.922407 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-a752d3fe-d754-4009-a132-4e66b9d7c4e4 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Action: 'create', calling method: .version_select at 0x7f5f88231670>, body: {"keypair": {"name": "tempest-keypair-46072299", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGsqmAZTKeivLAeTWJyp6BVGT5luIsY58s7oTURcquU4DyH5FpWxVGEShcrVSFpqucjcpYMkcPTrAl0YJ+HjkG5KacdLiQgYY4w7nWOIMCZ/bWxDYoRTEr7y5yUqcN2GEA=="}} {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:46:42.937675 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.quota [None req-a752d3fe-d754-4009-a132-4e66b9d7c4e4 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Getting quotas for project 6714e8cfaee34ac3af916af5e4bb1031. Resources: {'key_pairs'} {{(pid=118157) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 14:46:42.943112 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.quota [None req-a752d3fe-d754-4009-a132-4e66b9d7c4e4 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Getting quotas for user ed3353d3d8a242e1a6b54d31adf97a6d and project 6714e8cfaee34ac3af916af5e4bb1031. Resources: {'key_pairs'} {{(pid=118157) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 14:46:42.955613 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-8a2565f6-9d25-4e55-b672-82ea8e5482db tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:42.956074 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-8a2565f6-9d25-4e55-b672-82ea8e5482db tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:42.956572 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.objects.instance [None req-8a2565f6-9d25-4e55-b672-82ea8e5482db tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lazy-loading 'fault' on Instance uuid 7dec201c-634b-4b93-bc30-0ac8e60795c7 {{(pid=118158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 14:46:43.007121 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-8a2565f6-9d25-4e55-b672-82ea8e5482db tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:46:43.015580 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-8a2565f6-9d25-4e55-b672-82ea8e5482db tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7" status: 200 len: 1334 microversion: 2.1 time: 0.119496 Jun 07 14:46:43.016131 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 359/707] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:46:42 2022] GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7 => generated 1334 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:46:43.059568 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-a752d3fe-d754-4009-a132-4e66b9d7c4e4 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.20 time: 0.141955 Jun 07 14:46:43.060155 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 349/708] 10.222.0.85 () {62 vars in 1199 bytes} [Tue Jun 7 14:46:42 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 143 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jun 07 14:46:44.034129 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-89e4b835-4851-4aaa-ae19-931bba0d03bf tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:46:44.034747 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-89e4b835-4851-4aaa-ae19-931bba0d03bf tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 7dec201c-634b-4b93-bc30-0ac8e60795c7] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:46:44.041578 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-89e4b835-4851-4aaa-ae19-931bba0d03bf tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:44.042153 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-89e4b835-4851-4aaa-ae19-931bba0d03bf tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:44.042910 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-89e4b835-4851-4aaa-ae19-931bba0d03bf tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:44.043348 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-89e4b835-4851-4aaa-ae19-931bba0d03bf tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:44.047597 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG dbcounter [-] [118158] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:46:44.056862 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.wsgi [None req-89e4b835-4851-4aaa-ae19-931bba0d03bf tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] HTTP exception thrown: Instance 7dec201c-634b-4b93-bc30-0ac8e60795c7 could not be found. Jun 07 14:46:44.058494 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-89e4b835-4851-4aaa-ae19-931bba0d03bf tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Request method failure captured: Jun 07 14:46:44.058494 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: request: GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7 HTTP/1.1 Jun 07 14:46:44.058494 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Accept: application/json Jun 07 14:46:44.058494 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Accept-Encoding: identity Jun 07 14:46:44.058494 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Connection: close Jun 07 14:46:44.058494 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Content-Length: 0 Jun 07 14:46:44.058494 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Content-Type: application/json Jun 07 14:46:44.058494 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Host: 10.222.0.85 Jun 07 14:46:44.058494 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Openstack-System-Scope: None Jun 07 14:46:44.058494 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: User-Agent: python-urllib3/1.26.9 Jun 07 14:46:44.058494 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Auth-Token: gAAAAABin2MfoYDVhu2np0DRcQVNUXdKMfJ65XCHwNNgDzofb7UJB-BWXWBLWaEswfOjFb54DUFMtQxlwkMGgXmEQLjfj_mQyFqyWAiCHR0I3nl7bqHSoOmAgQ9B8P9sCJ5_1DmOjuYjvvS65ktGlA1sVBmQ3mMGWuAH2ULxrW_BKmx6e7vrexU Jun 07 14:46:44.058494 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Domain-Id: None Jun 07 14:46:44.058494 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Domain-Name: None Jun 07 14:46:44.058494 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Identity-Status: Confirmed Jun 07 14:46:44.058494 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Is-Admin-Project: True Jun 07 14:46:44.058494 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Domain-Id: default Jun 07 14:46:44.058494 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Domain-Name: Default Jun 07 14:46:44.058494 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Id: e80aa19d008640df9a1f924a7c03f7f6 Jun 07 14:46:44.058494 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1172669914 Jun 07 14:46:44.058494 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Role: member,reader Jun 07 14:46:44.058494 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Roles: member,reader Jun 07 14:46:44.060199 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e80aa19d008640df9a1f924a7c03f7f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_e80aa19d008640df9a1f924a7c03f7f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e80aa19d008640df9a1f924a7c03f7f6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/e80aa19d008640df9a1f924a7c03f7f6"}]}] Jun 07 14:46:44.060199 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1172669914 Jun 07 14:46:44.060199 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Tenant-Id: e80aa19d008640df9a1f924a7c03f7f6 Jun 07 14:46:44.060199 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1172669914 Jun 07 14:46:44.060199 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User: tempest-ServerRescueNegativeTestJSON-1172669914-project Jun 07 14:46:44.060199 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Domain-Id: default Jun 07 14:46:44.060199 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Domain-Name: Default Jun 07 14:46:44.060199 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Id: 48bbf88b32774d5da9ef93ac75686c34 Jun 07 14:46:44.060199 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1172669914-project Jun 07 14:46:44.060199 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: method: > Jun 07 14:46:44.060199 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: exception: Instance 7dec201c-634b-4b93-bc30-0ac8e60795c7 could not be found. Jun 07 14:46:44.060199 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: action_args: {'id': '7dec201c-634b-4b93-bc30-0ac8e60795c7'} Jun 07 14:46:44.061145 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:46:44.061145 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:46:44.061145 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 14:46:44.061145 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 14:46:44.061145 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 14:46:44.061145 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 14:46:44.061145 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 14:46:44.061145 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 14:46:44.061145 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 14:46:44.061145 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 14:46:44.061145 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7dec201c-634b-4b93-bc30-0ac8e60795c7 could not be found. Jun 07 14:46:44.061145 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:46:44.061145 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:46:44.061145 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:46:44.061145 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:46:44.061145 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:46:44.061145 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:46:44.061145 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:46:44.061145 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:46:44.061145 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:46:44.062389 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:46:44.062389 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 14:46:44.062389 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 14:46:44.062389 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 14:46:44.062389 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 14:46:44.062389 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 14:46:44.062389 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:46:44.062389 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7dec201c-634b-4b93-bc30-0ac8e60795c7 could not be found. Jun 07 14:46:44.062389 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:46:44.062389 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:46:44.062389 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:46:44.062389 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:46:44.062389 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:46:44.062389 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:46:44.062389 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:46:44.062389 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:46:44.062389 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7dec201c-634b-4b93-bc30-0ac8e60795c7 could not be found. Jun 07 14:46:44.062389 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:46:44.063435 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-89e4b835-4851-4aaa-ae19-931bba0d03bf tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Returning 404 to user: Instance 7dec201c-634b-4b93-bc30-0ac8e60795c7 could not be found. {{(pid=118158) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:46:44.063435 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-89e4b835-4851-4aaa-ae19-931bba0d03bf tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7" status: 404 len: 111 microversion: 2.1 time: 0.030383 Jun 07 14:46:44.063435 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 360/709] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:46:44 2022] GET /compute/v2.1/servers/7dec201c-634b-4b93-bc30-0ac8e60795c7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 14:46:44.069334 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-21b6edd2-4037-4559-b0f6-5a23c2e018ee tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '.version_select at 0x7f5f82f7ef70>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:46:44.135783 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-21b6edd2-4037-4559-b0f6-5a23c2e018ee tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-385740061" status: 202 len: 0 microversion: 2.1 time: 0.070881 Jun 07 14:46:44.146349 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 350/710] 10.222.0.85 () {58 vars in 1217 bytes} [Tue Jun 7 14:46:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-385740061 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 14:46:45.519042 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-5b046d84-31e8-419d-bdcf-3e29505d9a73 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-297365927", "imageRef": "7802ce25-d370-43a3-8d85-0257d644d539", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ba36f3f4-89b1-428d-a708-1cf3e01cddd9"}], "security_groups": [{"name": "tempest-securitygroup--480951750"}], "key_name": "tempest-keypair-46072299", "user_data": "}} {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:46:45.621790 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.network.neutron [None req-5b046d84-31e8-419d-bdcf-3e29505d9a73 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] validate_networks() for [('ba36f3f4-89b1-428d-a708-1cf3e01cddd9', None, None, None, None, None)] {{(pid=118158) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 14:46:46.014661 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.virt.hardware [None req-5b046d84-31e8-419d-bdcf-3e29505d9a73 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Flavor limits 0:0:0 {{(pid=118158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 14:46:46.015086 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.virt.hardware [None req-5b046d84-31e8-419d-bdcf-3e29505d9a73 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Image limits 0:0:0 {{(pid=118158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 14:46:46.015560 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.virt.hardware [None req-5b046d84-31e8-419d-bdcf-3e29505d9a73 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Flavor pref 0:0:0 {{(pid=118158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 14:46:46.015976 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.virt.hardware [None req-5b046d84-31e8-419d-bdcf-3e29505d9a73 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Image pref 0:0:0 {{(pid=118158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 14:46:46.016412 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.virt.hardware [None req-5b046d84-31e8-419d-bdcf-3e29505d9a73 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 14:46:46.026841 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5b046d84-31e8-419d-bdcf-3e29505d9a73 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:46.027383 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5b046d84-31e8-419d-bdcf-3e29505d9a73 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:46.028189 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5b046d84-31e8-419d-bdcf-3e29505d9a73 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:46.028667 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5b046d84-31e8-419d-bdcf-3e29505d9a73 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:46.045569 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.quota [None req-5b046d84-31e8-419d-bdcf-3e29505d9a73 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Getting quotas for project 6714e8cfaee34ac3af916af5e4bb1031. Resources: {'instances', 'cores', 'ram'} {{(pid=118158) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 14:46:46.049630 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.quota [None req-5b046d84-31e8-419d-bdcf-3e29505d9a73 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Getting quotas for user ed3353d3d8a242e1a6b54d31adf97a6d and project 6714e8cfaee34ac3af916af5e4bb1031. Resources: {'instances', 'cores', 'ram'} {{(pid=118158) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 14:46:46.060658 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-5b046d84-31e8-419d-bdcf-3e29505d9a73 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Going to run 1 instances... {{(pid=118158) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 14:46:46.062971 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-5b046d84-31e8-419d-bdcf-3e29505d9a73 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: 89db7091-f026-4913-962e-ad45fd38b468] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7802ce25-d370-43a3-8d85-0257d644d539',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118158) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 14:46:46.178215 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-5b046d84-31e8-419d-bdcf-3e29505d9a73 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.664258 Jun 07 14:46:46.179089 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 361/711] 10.222.0.85 () {62 vars in 1187 bytes} [Tue Jun 7 14:46:45 2022] POST /compute/v2.1/servers => generated 401 bytes in 666 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 07 14:46:46.190041 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-3850ce3f-9aed-4dd1-aa92-f5682e9b8144 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:46:46.191112 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-3850ce3f-9aed-4dd1-aa92-f5682e9b8144 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: 89db7091-f026-4913-962e-ad45fd38b468] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:46:46.500992 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-3850ce3f-9aed-4dd1-aa92-f5682e9b8144 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:46:46.513131 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-3850ce3f-9aed-4dd1-aa92-f5682e9b8144 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:46:46.514614 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-3850ce3f-9aed-4dd1-aa92-f5682e9b8144 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:46:46.515785 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-3850ce3f-9aed-4dd1-aa92-f5682e9b8144 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468" status: 200 len: 1279 microversion: 2.20 time: 0.330678 Jun 07 14:46:46.516347 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 351/712] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:46:46 2022] GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468 => generated 1279 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 14:46:47.500982 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-74e078e1-cf83-4c62-97ce-6ef1a69d0b64 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:46:47.501699 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-74e078e1-cf83-4c62-97ce-6ef1a69d0b64 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: ee2e782c-42ff-4093-9246-75d4e69929b3] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:46:47.507962 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-74e078e1-cf83-4c62-97ce-6ef1a69d0b64 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:47.508547 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-74e078e1-cf83-4c62-97ce-6ef1a69d0b64 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:47.509297 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-74e078e1-cf83-4c62-97ce-6ef1a69d0b64 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:47.509716 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-74e078e1-cf83-4c62-97ce-6ef1a69d0b64 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:47.535779 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-0b0e7bab-caec-4e84-9d28-293015f1d7fa tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:46:47.537126 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-0b0e7bab-caec-4e84-9d28-293015f1d7fa tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: 89db7091-f026-4913-962e-ad45fd38b468] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:46:47.542679 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-74e078e1-cf83-4c62-97ce-6ef1a69d0b64 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: ee2e782c-42ff-4093-9246-75d4e69929b3] Going to try to terminate instance {{(pid=118158) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 14:46:47.545794 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-0b0e7bab-caec-4e84-9d28-293015f1d7fa tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:47.550717 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-0b0e7bab-caec-4e84-9d28-293015f1d7fa tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:47.552421 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-0b0e7bab-caec-4e84-9d28-293015f1d7fa tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:47.553169 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-0b0e7bab-caec-4e84-9d28-293015f1d7fa tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:47.625332 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-0b0e7bab-caec-4e84-9d28-293015f1d7fa tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:46:47.633673 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-0b0e7bab-caec-4e84-9d28-293015f1d7fa tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:46:47.635213 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-0b0e7bab-caec-4e84-9d28-293015f1d7fa tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:46:47.636313 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-0b0e7bab-caec-4e84-9d28-293015f1d7fa tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468" status: 200 len: 1275 microversion: 2.20 time: 0.106319 Jun 07 14:46:47.636956 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 352/713] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:46:47 2022] GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468 => generated 1275 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 14:46:47.793692 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-74e078e1-cf83-4c62-97ce-6ef1a69d0b64 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "DELETE /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3" status: 204 len: 0 microversion: 2.1 time: 0.296912 Jun 07 14:46:47.794199 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 362/714] 10.222.0.85 () {58 vars in 1238 bytes} [Tue Jun 7 14:46:47 2022] DELETE /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 14:46:47.802826 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-30bd9170-c869-419b-982f-aa4515525ca8 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:46:47.803470 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-30bd9170-c869-419b-982f-aa4515525ca8 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: ee2e782c-42ff-4093-9246-75d4e69929b3] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:46:47.809916 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-30bd9170-c869-419b-982f-aa4515525ca8 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:47.810371 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-30bd9170-c869-419b-982f-aa4515525ca8 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:47.811147 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-30bd9170-c869-419b-982f-aa4515525ca8 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:47.811590 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-30bd9170-c869-419b-982f-aa4515525ca8 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:47.830508 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG dbcounter [-] [118157] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:46:47.947364 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-30bd9170-c869-419b-982f-aa4515525ca8 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:46:47.955295 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-30bd9170-c869-419b-982f-aa4515525ca8 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3" status: 200 len: 1505 microversion: 2.1 time: 0.156343 Jun 07 14:46:47.956148 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 353/715] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:46:47 2022] GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3 => generated 1505 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:46:48.655621 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-3109baf5-8279-48d5-9334-d66bde10c246 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:46:48.656328 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-3109baf5-8279-48d5-9334-d66bde10c246 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: 89db7091-f026-4913-962e-ad45fd38b468] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:46:48.663405 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-3109baf5-8279-48d5-9334-d66bde10c246 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:48.663856 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-3109baf5-8279-48d5-9334-d66bde10c246 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:48.664654 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-3109baf5-8279-48d5-9334-d66bde10c246 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:48.665090 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-3109baf5-8279-48d5-9334-d66bde10c246 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:48.736451 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-3109baf5-8279-48d5-9334-d66bde10c246 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:46:48.744574 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-3109baf5-8279-48d5-9334-d66bde10c246 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:46:48.746203 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-3109baf5-8279-48d5-9334-d66bde10c246 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:46:48.747283 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-3109baf5-8279-48d5-9334-d66bde10c246 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468" status: 200 len: 1339 microversion: 2.20 time: 0.095969 Jun 07 14:46:48.748163 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 363/716] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:46:48 2022] GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468 => generated 1339 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:46:48.972507 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-071e8d6e-a388-4622-a8bc-649e000d6582 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:46:48.973125 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-071e8d6e-a388-4622-a8bc-649e000d6582 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: ee2e782c-42ff-4093-9246-75d4e69929b3] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:46:48.980199 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-071e8d6e-a388-4622-a8bc-649e000d6582 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:48.980676 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-071e8d6e-a388-4622-a8bc-649e000d6582 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:48.981454 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-071e8d6e-a388-4622-a8bc-649e000d6582 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:48.981888 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-071e8d6e-a388-4622-a8bc-649e000d6582 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:49.162180 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-071e8d6e-a388-4622-a8bc-649e000d6582 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:46:49.169831 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-071e8d6e-a388-4622-a8bc-649e000d6582 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3" status: 200 len: 1505 microversion: 2.1 time: 0.201163 Jun 07 14:46:49.170407 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 354/717] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:46:48 2022] GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3 => generated 1505 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:46:49.318461 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [req-47f7499c-565b-45bb-9e17-8d436ba80dd9 req-353e37bf-6263-458f-8c66-2e0bedee673b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee2e782c-42ff-4093-9246-75d4e69929b3", "name": "network-vif-deleted", "tag": "459067e8-6ae6-4176-ac6a-fa525305f17b"}]} {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:46:49.332199 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [req-47f7499c-565b-45bb-9e17-8d436ba80dd9 req-353e37bf-6263-458f-8c66-2e0bedee673b service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:49.332199 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [req-47f7499c-565b-45bb-9e17-8d436ba80dd9 req-353e37bf-6263-458f-8c66-2e0bedee673b service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:49.340690 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.compute.server_external_events [req-47f7499c-565b-45bb-9e17-8d436ba80dd9 req-353e37bf-6263-458f-8c66-2e0bedee673b service nova] Creating event network-vif-deleted:459067e8-6ae6-4176-ac6a-fa525305f17b for instance ee2e782c-42ff-4093-9246-75d4e69929b3 on hv-cinder-84497 Jun 07 14:46:49.346282 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [req-47f7499c-565b-45bb-9e17-8d436ba80dd9 req-353e37bf-6263-458f-8c66-2e0bedee673b service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032205 Jun 07 14:46:49.346729 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 364/718] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jun 7 14:46:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:46:49.773320 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-d67aa794-826d-44a5-a078-52e9e55d9583 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:46:49.774035 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-d67aa794-826d-44a5-a078-52e9e55d9583 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: 89db7091-f026-4913-962e-ad45fd38b468] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:46:49.780906 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-d67aa794-826d-44a5-a078-52e9e55d9583 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:49.781484 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-d67aa794-826d-44a5-a078-52e9e55d9583 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:49.782362 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-d67aa794-826d-44a5-a078-52e9e55d9583 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:49.783448 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-d67aa794-826d-44a5-a078-52e9e55d9583 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:49.918040 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-d67aa794-826d-44a5-a078-52e9e55d9583 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:46:49.926819 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-d67aa794-826d-44a5-a078-52e9e55d9583 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:46:49.928455 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-d67aa794-826d-44a5-a078-52e9e55d9583 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:46:49.929581 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-d67aa794-826d-44a5-a078-52e9e55d9583 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468" status: 200 len: 1404 microversion: 2.20 time: 0.160649 Jun 07 14:46:49.930130 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 355/719] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:46:49 2022] GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468 => generated 1404 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:46:50.190676 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-a7d51d4f-f782-421d-a47d-0b39de20df31 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:46:50.194707 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-a7d51d4f-f782-421d-a47d-0b39de20df31 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: ee2e782c-42ff-4093-9246-75d4e69929b3] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:46:50.198498 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-a7d51d4f-f782-421d-a47d-0b39de20df31 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:50.198955 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-a7d51d4f-f782-421d-a47d-0b39de20df31 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:50.199726 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-a7d51d4f-f782-421d-a47d-0b39de20df31 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:50.200160 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-a7d51d4f-f782-421d-a47d-0b39de20df31 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:50.232844 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-a7d51d4f-f782-421d-a47d-0b39de20df31 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:50.233291 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-a7d51d4f-f782-421d-a47d-0b39de20df31 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:50.233740 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.objects.instance [None req-a7d51d4f-f782-421d-a47d-0b39de20df31 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lazy-loading 'fault' on Instance uuid ee2e782c-42ff-4093-9246-75d4e69929b3 {{(pid=118158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 14:46:50.277150 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-a7d51d4f-f782-421d-a47d-0b39de20df31 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:46:50.284783 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-a7d51d4f-f782-421d-a47d-0b39de20df31 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3" status: 200 len: 1309 microversion: 2.1 time: 0.101346 Jun 07 14:46:50.285352 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 365/720] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:46:50 2022] GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3 => generated 1309 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:46:50.422311 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-14a283ce-911f-4a0f-a729-e5724629554f tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:46:50.423415 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-14a283ce-911f-4a0f-a729-e5724629554f tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:46:50.431597 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-14a283ce-911f-4a0f-a729-e5724629554f tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:50.432247 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-14a283ce-911f-4a0f-a729-e5724629554f tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:50.433359 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-14a283ce-911f-4a0f-a729-e5724629554f tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:50.433868 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-14a283ce-911f-4a0f-a729-e5724629554f tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:50.473270 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-14a283ce-911f-4a0f-a729-e5724629554f tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055895 Jun 07 14:46:50.474265 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 356/721] 10.222.0.85 () {58 vars in 1301 bytes} [Tue Jun 7 14:46:50 2022] GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 07 14:46:50.538365 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-6bcab8d1-b0f8-4ad4-ad70-0da7b50e01f5 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:46:50.538862 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-6bcab8d1-b0f8-4ad4-ad70-0da7b50e01f5 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:46:50.544846 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-6bcab8d1-b0f8-4ad4-ad70-0da7b50e01f5 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:50.545289 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-6bcab8d1-b0f8-4ad4-ad70-0da7b50e01f5 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:50.546039 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-6bcab8d1-b0f8-4ad4-ad70-0da7b50e01f5 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:50.546467 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-6bcab8d1-b0f8-4ad4-ad70-0da7b50e01f5 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:50.572860 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-6bcab8d1-b0f8-4ad4-ad70-0da7b50e01f5 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6] Going to try to terminate instance {{(pid=118158) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 14:46:50.624896 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [req-faecd274-40cd-4fc9-b94a-ea9354dbe9bc req-ef2af778-6dc0-4267-88e2-1975e2301652 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89db7091-f026-4913-962e-ad45fd38b468", "tag": "cf25b5fc-6d60-40d5-8461-593838e20baf"}]} {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:46:50.634948 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [req-faecd274-40cd-4fc9-b94a-ea9354dbe9bc req-ef2af778-6dc0-4267-88e2-1975e2301652 service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:50.635570 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [req-faecd274-40cd-4fc9-b94a-ea9354dbe9bc req-ef2af778-6dc0-4267-88e2-1975e2301652 service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:50.649311 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.compute.server_external_events [req-faecd274-40cd-4fc9-b94a-ea9354dbe9bc req-ef2af778-6dc0-4267-88e2-1975e2301652 service nova] Creating event network-changed:cf25b5fc-6d60-40d5-8461-593838e20baf for instance 89db7091-f026-4913-962e-ad45fd38b468 on hv-cinder-84497 Jun 07 14:46:50.655486 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [req-faecd274-40cd-4fc9-b94a-ea9354dbe9bc req-ef2af778-6dc0-4267-88e2-1975e2301652 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035023 Jun 07 14:46:50.656352 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 357/722] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jun 7 14:46:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 14:46:50.883449 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-6bcab8d1-b0f8-4ad4-ad70-0da7b50e01f5 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "DELETE /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6" status: 204 len: 0 microversion: 2.1 time: 0.348514 Jun 07 14:46:50.883978 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 366/723] 10.222.0.85 () {58 vars in 1238 bytes} [Tue Jun 7 14:46:50 2022] DELETE /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 14:46:50.893272 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-a57d3f71-223b-4cdf-a5d2-c00391ac07fb tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:46:50.893914 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-a57d3f71-223b-4cdf-a5d2-c00391ac07fb tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:46:50.900598 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-a57d3f71-223b-4cdf-a5d2-c00391ac07fb tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:50.901056 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-a57d3f71-223b-4cdf-a5d2-c00391ac07fb tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:50.901828 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-a57d3f71-223b-4cdf-a5d2-c00391ac07fb tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:50.902264 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-a57d3f71-223b-4cdf-a5d2-c00391ac07fb tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:50.950417 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-8327a231-cce4-4dda-9e17-6f8f22c0a2eb tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:46:50.951248 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-8327a231-cce4-4dda-9e17-6f8f22c0a2eb tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: 89db7091-f026-4913-962e-ad45fd38b468] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:46:50.957646 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-8327a231-cce4-4dda-9e17-6f8f22c0a2eb tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:50.958138 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-8327a231-cce4-4dda-9e17-6f8f22c0a2eb tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:50.958983 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-8327a231-cce4-4dda-9e17-6f8f22c0a2eb tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:50.959493 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-8327a231-cce4-4dda-9e17-6f8f22c0a2eb tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:51.033937 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-a57d3f71-223b-4cdf-a5d2-c00391ac07fb tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb4b0cf5f8b4274b787f327793964f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ba26b86c7243dab8e6c6b84ed674e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:46:51.041649 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-a57d3f71-223b-4cdf-a5d2-c00391ac07fb tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6" status: 200 len: 1675 microversion: 2.1 time: 0.153152 Jun 07 14:46:51.042208 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 358/724] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:46:50 2022] GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:46:51.093261 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-8327a231-cce4-4dda-9e17-6f8f22c0a2eb tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:46:51.101698 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-8327a231-cce4-4dda-9e17-6f8f22c0a2eb tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:46:51.103233 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-8327a231-cce4-4dda-9e17-6f8f22c0a2eb tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:46:51.104343 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-8327a231-cce4-4dda-9e17-6f8f22c0a2eb tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468" status: 200 len: 1404 microversion: 2.20 time: 0.158214 Jun 07 14:46:51.104920 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 367/725] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:46:50 2022] GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468 => generated 1404 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 14:46:51.305669 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-f8b5107c-e451-419b-8c00-0cf303fc2a44 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:46:51.306281 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-f8b5107c-e451-419b-8c00-0cf303fc2a44 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: ee2e782c-42ff-4093-9246-75d4e69929b3] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:46:51.312341 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-f8b5107c-e451-419b-8c00-0cf303fc2a44 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:51.312821 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-f8b5107c-e451-419b-8c00-0cf303fc2a44 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:51.313581 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-f8b5107c-e451-419b-8c00-0cf303fc2a44 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:51.314016 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-f8b5107c-e451-419b-8c00-0cf303fc2a44 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:51.326905 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.wsgi [None req-f8b5107c-e451-419b-8c00-0cf303fc2a44 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] HTTP exception thrown: Instance ee2e782c-42ff-4093-9246-75d4e69929b3 could not be found. Jun 07 14:46:51.328559 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-f8b5107c-e451-419b-8c00-0cf303fc2a44 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Request method failure captured: Jun 07 14:46:51.328559 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: request: GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3 HTTP/1.1 Jun 07 14:46:51.328559 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Accept: application/json Jun 07 14:46:51.328559 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Accept-Encoding: identity Jun 07 14:46:51.328559 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Connection: close Jun 07 14:46:51.328559 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Content-Length: 0 Jun 07 14:46:51.328559 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Content-Type: application/json Jun 07 14:46:51.328559 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Host: 10.222.0.85 Jun 07 14:46:51.328559 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Openstack-System-Scope: None Jun 07 14:46:51.328559 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: User-Agent: python-urllib3/1.26.9 Jun 07 14:46:51.328559 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Auth-Token: gAAAAABin2MfoYDVhu2np0DRcQVNUXdKMfJ65XCHwNNgDzofb7UJB-BWXWBLWaEswfOjFb54DUFMtQxlwkMGgXmEQLjfj_mQyFqyWAiCHR0I3nl7bqHSoOmAgQ9B8P9sCJ5_1DmOjuYjvvS65ktGlA1sVBmQ3mMGWuAH2ULxrW_BKmx6e7vrexU Jun 07 14:46:51.328559 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Domain-Id: None Jun 07 14:46:51.328559 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Domain-Name: None Jun 07 14:46:51.328559 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Identity-Status: Confirmed Jun 07 14:46:51.328559 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Is-Admin-Project: True Jun 07 14:46:51.328559 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Project-Domain-Id: default Jun 07 14:46:51.328559 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Project-Domain-Name: Default Jun 07 14:46:51.328559 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Project-Id: e80aa19d008640df9a1f924a7c03f7f6 Jun 07 14:46:51.328559 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1172669914 Jun 07 14:46:51.328559 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Role: member,reader Jun 07 14:46:51.328559 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Roles: member,reader Jun 07 14:46:51.330080 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e80aa19d008640df9a1f924a7c03f7f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_e80aa19d008640df9a1f924a7c03f7f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e80aa19d008640df9a1f924a7c03f7f6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/e80aa19d008640df9a1f924a7c03f7f6"}]}] Jun 07 14:46:51.330080 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1172669914 Jun 07 14:46:51.330080 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Tenant-Id: e80aa19d008640df9a1f924a7c03f7f6 Jun 07 14:46:51.330080 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1172669914 Jun 07 14:46:51.330080 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User: tempest-ServerRescueNegativeTestJSON-1172669914-project Jun 07 14:46:51.330080 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User-Domain-Id: default Jun 07 14:46:51.330080 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User-Domain-Name: Default Jun 07 14:46:51.330080 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User-Id: 48bbf88b32774d5da9ef93ac75686c34 Jun 07 14:46:51.330080 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1172669914-project Jun 07 14:46:51.330080 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: method: > Jun 07 14:46:51.330080 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: exception: Instance ee2e782c-42ff-4093-9246-75d4e69929b3 could not be found. Jun 07 14:46:51.330080 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: action_args: {'id': 'ee2e782c-42ff-4093-9246-75d4e69929b3'} Jun 07 14:46:51.330943 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:46:51.330943 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:46:51.330943 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 14:46:51.330943 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 14:46:51.330943 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 14:46:51.330943 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 14:46:51.330943 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 14:46:51.330943 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 14:46:51.330943 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 14:46:51.330943 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 14:46:51.330943 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee2e782c-42ff-4093-9246-75d4e69929b3 could not be found. Jun 07 14:46:51.330943 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:46:51.330943 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:46:51.330943 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:46:51.330943 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:46:51.330943 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:46:51.330943 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:46:51.330943 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:46:51.330943 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:46:51.330943 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:46:51.332442 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:46:51.332442 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 14:46:51.332442 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 14:46:51.332442 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 14:46:51.332442 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 14:46:51.332442 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 14:46:51.332442 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:46:51.332442 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee2e782c-42ff-4093-9246-75d4e69929b3 could not be found. Jun 07 14:46:51.332442 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:46:51.332442 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:46:51.332442 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:46:51.332442 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:46:51.332442 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:46:51.332442 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:46:51.332442 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:46:51.332442 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:46:51.332442 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee2e782c-42ff-4093-9246-75d4e69929b3 could not be found. Jun 07 14:46:51.332442 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:46:51.333993 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-f8b5107c-e451-419b-8c00-0cf303fc2a44 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Returning 404 to user: Instance ee2e782c-42ff-4093-9246-75d4e69929b3 could not be found. {{(pid=118157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:46:51.333993 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-f8b5107c-e451-419b-8c00-0cf303fc2a44 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3" status: 404 len: 111 microversion: 2.1 time: 0.028158 Jun 07 14:46:51.333993 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 359/726] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:46:51 2022] GET /compute/v2.1/servers/ee2e782c-42ff-4093-9246-75d4e69929b3 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 14:46:51.338221 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-8686152c-47fb-451f-a75e-99c8f37dd329 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:46:51.338718 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-8686152c-47fb-451f-a75e-99c8f37dd329 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 45f65f98-e1ca-4e07-872a-ef0403e2d50a] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:46:51.345131 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-8686152c-47fb-451f-a75e-99c8f37dd329 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:51.346102 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-8686152c-47fb-451f-a75e-99c8f37dd329 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:51.346859 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-8686152c-47fb-451f-a75e-99c8f37dd329 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:51.347292 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-8686152c-47fb-451f-a75e-99c8f37dd329 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:51.372092 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-8686152c-47fb-451f-a75e-99c8f37dd329 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 45f65f98-e1ca-4e07-872a-ef0403e2d50a] Going to try to terminate instance {{(pid=118158) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 14:46:51.620247 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-8686152c-47fb-451f-a75e-99c8f37dd329 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "DELETE /compute/v2.1/servers/45f65f98-e1ca-4e07-872a-ef0403e2d50a" status: 204 len: 0 microversion: 2.1 time: 0.285411 Jun 07 14:46:51.620799 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 368/727] 10.222.0.85 () {58 vars in 1238 bytes} [Tue Jun 7 14:46:51 2022] DELETE /compute/v2.1/servers/45f65f98-e1ca-4e07-872a-ef0403e2d50a => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 07 14:46:51.629094 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-af7bb2ea-2f89-42ba-82e3-e23c10f17d21 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:46:51.629762 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-af7bb2ea-2f89-42ba-82e3-e23c10f17d21 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 45f65f98-e1ca-4e07-872a-ef0403e2d50a] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:46:51.636361 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-af7bb2ea-2f89-42ba-82e3-e23c10f17d21 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:51.636844 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-af7bb2ea-2f89-42ba-82e3-e23c10f17d21 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:51.637640 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-af7bb2ea-2f89-42ba-82e3-e23c10f17d21 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:51.638106 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-af7bb2ea-2f89-42ba-82e3-e23c10f17d21 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:51.770101 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-af7bb2ea-2f89-42ba-82e3-e23c10f17d21 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:46:51.777933 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-af7bb2ea-2f89-42ba-82e3-e23c10f17d21 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/45f65f98-e1ca-4e07-872a-ef0403e2d50a" status: 200 len: 1522 microversion: 2.1 time: 0.152807 Jun 07 14:46:51.778482 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 360/728] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:46:51 2022] GET /compute/v2.1/servers/45f65f98-e1ca-4e07-872a-ef0403e2d50a => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:46:52.059524 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-0e14f0eb-f391-48d9-ac28-aa57e7bba1b1 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:46:52.060228 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-0e14f0eb-f391-48d9-ac28-aa57e7bba1b1 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:46:52.066836 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-0e14f0eb-f391-48d9-ac28-aa57e7bba1b1 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:52.067296 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-0e14f0eb-f391-48d9-ac28-aa57e7bba1b1 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:52.068056 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-0e14f0eb-f391-48d9-ac28-aa57e7bba1b1 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:52.068548 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-0e14f0eb-f391-48d9-ac28-aa57e7bba1b1 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:52.123247 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-88053ad0-9d0a-4ed7-928f-2f46a537d152 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:46:52.123890 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-88053ad0-9d0a-4ed7-928f-2f46a537d152 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: 89db7091-f026-4913-962e-ad45fd38b468] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:46:52.130732 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-88053ad0-9d0a-4ed7-928f-2f46a537d152 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:52.131186 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-88053ad0-9d0a-4ed7-928f-2f46a537d152 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:52.132900 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-88053ad0-9d0a-4ed7-928f-2f46a537d152 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:52.132900 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-88053ad0-9d0a-4ed7-928f-2f46a537d152 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:52.233347 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-0e14f0eb-f391-48d9-ac28-aa57e7bba1b1 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb4b0cf5f8b4274b787f327793964f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ba26b86c7243dab8e6c6b84ed674e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:46:52.240563 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-0e14f0eb-f391-48d9-ac28-aa57e7bba1b1 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6" status: 200 len: 1675 microversion: 2.1 time: 0.185135 Jun 07 14:46:52.241230 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 369/729] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:46:52 2022] GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 => generated 1675 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:46:52.310410 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-88053ad0-9d0a-4ed7-928f-2f46a537d152 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:46:52.318572 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-88053ad0-9d0a-4ed7-928f-2f46a537d152 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:46:52.320063 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-88053ad0-9d0a-4ed7-928f-2f46a537d152 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:46:52.321207 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-88053ad0-9d0a-4ed7-928f-2f46a537d152 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468" status: 200 len: 1404 microversion: 2.20 time: 0.202123 Jun 07 14:46:52.321776 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 361/730] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:46:52 2022] GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468 => generated 1404 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 14:46:52.795292 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-cf510184-b72c-4f6a-abbf-be627c6cf497 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:46:52.796750 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-cf510184-b72c-4f6a-abbf-be627c6cf497 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 45f65f98-e1ca-4e07-872a-ef0403e2d50a] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:46:52.806454 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG dbcounter [-] [118158] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=4,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:46:52.810549 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-cf510184-b72c-4f6a-abbf-be627c6cf497 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:52.811145 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-cf510184-b72c-4f6a-abbf-be627c6cf497 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:52.812458 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-cf510184-b72c-4f6a-abbf-be627c6cf497 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:52.813398 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-cf510184-b72c-4f6a-abbf-be627c6cf497 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:53.060112 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-cf510184-b72c-4f6a-abbf-be627c6cf497 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:46:53.068072 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-cf510184-b72c-4f6a-abbf-be627c6cf497 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/45f65f98-e1ca-4e07-872a-ef0403e2d50a" status: 200 len: 1522 microversion: 2.1 time: 0.276616 Jun 07 14:46:53.070548 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 370/731] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:46:52 2022] GET /compute/v2.1/servers/45f65f98-e1ca-4e07-872a-ef0403e2d50a => generated 1522 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:46:53.258732 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-5c0ec7ae-715b-4b37-9f02-58908d73f1bd tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:46:53.259374 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-5c0ec7ae-715b-4b37-9f02-58908d73f1bd tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:46:53.266333 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-5c0ec7ae-715b-4b37-9f02-58908d73f1bd tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:53.272469 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-5c0ec7ae-715b-4b37-9f02-58908d73f1bd tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:53.272469 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-5c0ec7ae-715b-4b37-9f02-58908d73f1bd tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:53.272469 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-5c0ec7ae-715b-4b37-9f02-58908d73f1bd tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:53.334706 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [req-9409764a-07f7-4991-ae13-183e4d9de166 req-bdb47531-c0f3-41a6-ab85-c4190d498871 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6", "name": "network-vif-deleted", "tag": "0846b81f-bd2c-4547-87e2-dc3a37931c85"}]} {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:46:53.352435 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [req-9409764a-07f7-4991-ae13-183e4d9de166 req-bdb47531-c0f3-41a6-ab85-c4190d498871 service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:53.352981 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [req-9409764a-07f7-4991-ae13-183e4d9de166 req-bdb47531-c0f3-41a6-ab85-c4190d498871 service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:53.355978 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-5c0ec7ae-715b-4b37-9f02-58908d73f1bd tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb4b0cf5f8b4274b787f327793964f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ba26b86c7243dab8e6c6b84ed674e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:46:53.365051 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-5c0ec7ae-715b-4b37-9f02-58908d73f1bd tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6" status: 200 len: 1608 microversion: 2.1 time: 0.110354 Jun 07 14:46:53.365699 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 362/732] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:46:53 2022] GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 => generated 1608 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:46:53.370719 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-e7878b29-a04f-464b-9566-8baa4fdfc667 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:46:53.371771 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-e7878b29-a04f-464b-9566-8baa4fdfc667 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: 89db7091-f026-4913-962e-ad45fd38b468] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:46:53.375577 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.compute.server_external_events [req-9409764a-07f7-4991-ae13-183e4d9de166 req-bdb47531-c0f3-41a6-ab85-c4190d498871 service nova] Creating event network-vif-deleted:0846b81f-bd2c-4547-87e2-dc3a37931c85 for instance e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 on hv-cinder-84497 Jun 07 14:46:53.382378 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [req-9409764a-07f7-4991-ae13-183e4d9de166 req-bdb47531-c0f3-41a6-ab85-c4190d498871 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055696 Jun 07 14:46:53.383020 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 371/733] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jun 7 14:46:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 14:46:53.383435 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-e7878b29-a04f-464b-9566-8baa4fdfc667 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:53.384106 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-e7878b29-a04f-464b-9566-8baa4fdfc667 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:53.385324 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-e7878b29-a04f-464b-9566-8baa4fdfc667 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:53.386753 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-e7878b29-a04f-464b-9566-8baa4fdfc667 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:53.388212 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [req-7fd3410b-3034-4846-8993-c5561fccc514 req-c3718e09-8aeb-44a4-a3d7-5ee78cec969b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45f65f98-e1ca-4e07-872a-ef0403e2d50a", "name": "network-vif-deleted", "tag": "568ba600-2682-4efd-8fd6-ca711d30e17a"}]} {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:46:53.398369 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [req-7fd3410b-3034-4846-8993-c5561fccc514 req-c3718e09-8aeb-44a4-a3d7-5ee78cec969b service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:53.398790 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [req-7fd3410b-3034-4846-8993-c5561fccc514 req-c3718e09-8aeb-44a4-a3d7-5ee78cec969b service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:53.411427 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.compute.server_external_events [req-7fd3410b-3034-4846-8993-c5561fccc514 req-c3718e09-8aeb-44a4-a3d7-5ee78cec969b service nova] Creating event network-vif-deleted:568ba600-2682-4efd-8fd6-ca711d30e17a for instance 45f65f98-e1ca-4e07-872a-ef0403e2d50a on hv-cinder-84497 Jun 07 14:46:53.424484 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [req-7fd3410b-3034-4846-8993-c5561fccc514 req-c3718e09-8aeb-44a4-a3d7-5ee78cec969b service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032179 Jun 07 14:46:53.425350 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 372/734] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jun 7 14:46:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:46:53.543405 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-e7878b29-a04f-464b-9566-8baa4fdfc667 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:46:53.552110 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-e7878b29-a04f-464b-9566-8baa4fdfc667 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:46:53.553676 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-e7878b29-a04f-464b-9566-8baa4fdfc667 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:46:53.554800 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-e7878b29-a04f-464b-9566-8baa4fdfc667 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468" status: 200 len: 1404 microversion: 2.20 time: 0.187955 Jun 07 14:46:53.555355 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 363/735] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:46:53 2022] GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468 => generated 1404 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:46:54.086215 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-8fad5cbb-0e7b-42b2-a880-ec7a99084f47 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:46:54.086940 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-8fad5cbb-0e7b-42b2-a880-ec7a99084f47 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 45f65f98-e1ca-4e07-872a-ef0403e2d50a] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:46:54.093548 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-8fad5cbb-0e7b-42b2-a880-ec7a99084f47 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:54.093997 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-8fad5cbb-0e7b-42b2-a880-ec7a99084f47 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:54.094762 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-8fad5cbb-0e7b-42b2-a880-ec7a99084f47 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:54.095195 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-8fad5cbb-0e7b-42b2-a880-ec7a99084f47 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:54.162939 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-8fad5cbb-0e7b-42b2-a880-ec7a99084f47 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:46:54.171118 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-8fad5cbb-0e7b-42b2-a880-ec7a99084f47 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/45f65f98-e1ca-4e07-872a-ef0403e2d50a" status: 200 len: 1480 microversion: 2.1 time: 0.089227 Jun 07 14:46:54.171825 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 373/736] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:46:54 2022] GET /compute/v2.1/servers/45f65f98-e1ca-4e07-872a-ef0403e2d50a => generated 1480 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:46:54.383139 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-399fba01-3d28-4856-ae7b-7abd628858c7 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:46:54.383813 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-399fba01-3d28-4856-ae7b-7abd628858c7 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:46:54.390695 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-399fba01-3d28-4856-ae7b-7abd628858c7 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:54.391149 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-399fba01-3d28-4856-ae7b-7abd628858c7 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:54.391923 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-399fba01-3d28-4856-ae7b-7abd628858c7 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:54.393005 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-399fba01-3d28-4856-ae7b-7abd628858c7 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:54.456715 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-399fba01-3d28-4856-ae7b-7abd628858c7 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb4b0cf5f8b4274b787f327793964f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ba26b86c7243dab8e6c6b84ed674e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:46:54.464486 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-399fba01-3d28-4856-ae7b-7abd628858c7 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6" status: 200 len: 1608 microversion: 2.1 time: 0.085374 Jun 07 14:46:54.465042 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 364/737] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:46:54 2022] GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 => generated 1608 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:46:54.573403 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-ff35b8d2-3df0-4d78-b7c0-20f9cda0fd29 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:46:54.574021 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-ff35b8d2-3df0-4d78-b7c0-20f9cda0fd29 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: 89db7091-f026-4913-962e-ad45fd38b468] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:46:54.580041 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-ff35b8d2-3df0-4d78-b7c0-20f9cda0fd29 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:54.580527 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-ff35b8d2-3df0-4d78-b7c0-20f9cda0fd29 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:54.581474 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-ff35b8d2-3df0-4d78-b7c0-20f9cda0fd29 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:54.581908 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-ff35b8d2-3df0-4d78-b7c0-20f9cda0fd29 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:54.710613 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-ff35b8d2-3df0-4d78-b7c0-20f9cda0fd29 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:46:54.714306 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG dbcounter [-] [118158] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=118158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:46:54.719036 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-ff35b8d2-3df0-4d78-b7c0-20f9cda0fd29 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:46:54.720649 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-ff35b8d2-3df0-4d78-b7c0-20f9cda0fd29 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:46:54.721759 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-ff35b8d2-3df0-4d78-b7c0-20f9cda0fd29 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468" status: 200 len: 1404 microversion: 2.20 time: 0.152278 Jun 07 14:46:54.722312 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 374/738] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:46:54 2022] GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468 => generated 1404 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:46:55.187989 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-9b582c3c-3efe-4d6d-90a9-009220bdbb47 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:46:55.188633 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-9b582c3c-3efe-4d6d-90a9-009220bdbb47 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 45f65f98-e1ca-4e07-872a-ef0403e2d50a] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:46:55.195287 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-9b582c3c-3efe-4d6d-90a9-009220bdbb47 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:55.195742 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-9b582c3c-3efe-4d6d-90a9-009220bdbb47 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:55.196561 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-9b582c3c-3efe-4d6d-90a9-009220bdbb47 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:55.196997 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-9b582c3c-3efe-4d6d-90a9-009220bdbb47 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:55.261594 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-9b582c3c-3efe-4d6d-90a9-009220bdbb47 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:46:55.271263 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-9b582c3c-3efe-4d6d-90a9-009220bdbb47 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/45f65f98-e1ca-4e07-872a-ef0403e2d50a" status: 200 len: 1480 microversion: 2.1 time: 0.086942 Jun 07 14:46:55.272206 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 365/739] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:46:55 2022] GET /compute/v2.1/servers/45f65f98-e1ca-4e07-872a-ef0403e2d50a => generated 1480 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:46:55.481029 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-154cd878-b614-4015-a921-9e06502418f2 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:46:55.481667 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-154cd878-b614-4015-a921-9e06502418f2 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:46:55.488366 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-154cd878-b614-4015-a921-9e06502418f2 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:55.489136 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-154cd878-b614-4015-a921-9e06502418f2 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:55.489581 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-154cd878-b614-4015-a921-9e06502418f2 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:55.490016 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-154cd878-b614-4015-a921-9e06502418f2 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:55.557501 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-154cd878-b614-4015-a921-9e06502418f2 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb4b0cf5f8b4274b787f327793964f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ba26b86c7243dab8e6c6b84ed674e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:46:55.565211 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-154cd878-b614-4015-a921-9e06502418f2 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6" status: 200 len: 1323 microversion: 2.1 time: 0.088507 Jun 07 14:46:55.565769 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 375/740] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:46:55 2022] GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 => generated 1323 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:46:55.677908 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-97722ff9-5d6c-4fe7-bc03-50b780503a04 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:46:55.678441 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-97722ff9-5d6c-4fe7-bc03-50b780503a04 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: bac69e34-ec55-4f0b-8856-8411fe7ea17a] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:46:55.685045 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-97722ff9-5d6c-4fe7-bc03-50b780503a04 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:55.685495 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-97722ff9-5d6c-4fe7-bc03-50b780503a04 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:55.686260 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-97722ff9-5d6c-4fe7-bc03-50b780503a04 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:55.686802 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-97722ff9-5d6c-4fe7-bc03-50b780503a04 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:55.713086 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-97722ff9-5d6c-4fe7-bc03-50b780503a04 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: bac69e34-ec55-4f0b-8856-8411fe7ea17a] Going to try to terminate instance {{(pid=118157) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 14:46:55.739334 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-c46d1f19-739b-4799-85dd-5374a53d7180 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:46:55.739945 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-c46d1f19-739b-4799-85dd-5374a53d7180 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: 89db7091-f026-4913-962e-ad45fd38b468] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:46:55.745968 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-c46d1f19-739b-4799-85dd-5374a53d7180 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:55.746412 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-c46d1f19-739b-4799-85dd-5374a53d7180 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:55.747166 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-c46d1f19-739b-4799-85dd-5374a53d7180 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:55.747596 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-c46d1f19-739b-4799-85dd-5374a53d7180 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:55.881193 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-c46d1f19-739b-4799-85dd-5374a53d7180 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:46:55.889254 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-c46d1f19-739b-4799-85dd-5374a53d7180 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:46:55.890892 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-c46d1f19-739b-4799-85dd-5374a53d7180 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:46:55.891994 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-c46d1f19-739b-4799-85dd-5374a53d7180 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468" status: 200 len: 1404 microversion: 2.20 time: 0.156901 Jun 07 14:46:55.893235 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 376/741] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:46:55 2022] GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468 => generated 1404 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 14:46:55.991511 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-97722ff9-5d6c-4fe7-bc03-50b780503a04 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "DELETE /compute/v2.1/servers/bac69e34-ec55-4f0b-8856-8411fe7ea17a" status: 204 len: 0 microversion: 2.1 time: 0.317321 Jun 07 14:46:55.992089 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 366/742] 10.222.0.85 () {58 vars in 1238 bytes} [Tue Jun 7 14:46:55 2022] DELETE /compute/v2.1/servers/bac69e34-ec55-4f0b-8856-8411fe7ea17a => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 14:46:56.000407 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-e8c29ffd-6c59-4b2d-9bf4-220f31fcf930 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:46:56.005742 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-e8c29ffd-6c59-4b2d-9bf4-220f31fcf930 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: bac69e34-ec55-4f0b-8856-8411fe7ea17a] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:46:56.008195 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-e8c29ffd-6c59-4b2d-9bf4-220f31fcf930 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:56.008938 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-e8c29ffd-6c59-4b2d-9bf4-220f31fcf930 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:56.009878 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-e8c29ffd-6c59-4b2d-9bf4-220f31fcf930 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:56.010414 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-e8c29ffd-6c59-4b2d-9bf4-220f31fcf930 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:56.039682 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG dbcounter [-] [118158] Writing DB stats nova_cell0:SELECT=2 {{(pid=118158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:46:56.057010 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG dbcounter [-] [118158] Writing DB stats nova_cell0:SELECT=6 {{(pid=118158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:46:56.146211 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-e8c29ffd-6c59-4b2d-9bf4-220f31fcf930 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15f5fa82414bdf8ca3f6723c0a8d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e877695d0f46339cb4b9b86aac3662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:46:56.154907 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-e8c29ffd-6c59-4b2d-9bf4-220f31fcf930 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "GET /compute/v2.1/servers/bac69e34-ec55-4f0b-8856-8411fe7ea17a" status: 200 len: 1576 microversion: 2.1 time: 0.158359 Jun 07 14:46:56.155607 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 377/743] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:46:55 2022] GET /compute/v2.1/servers/bac69e34-ec55-4f0b-8856-8411fe7ea17a => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:46:56.289532 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-cb28b0c7-07a2-4185-85cd-e808926a3b64 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:46:56.290242 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-cb28b0c7-07a2-4185-85cd-e808926a3b64 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 45f65f98-e1ca-4e07-872a-ef0403e2d50a] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:46:56.296297 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-cb28b0c7-07a2-4185-85cd-e808926a3b64 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:56.298296 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-cb28b0c7-07a2-4185-85cd-e808926a3b64 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:56.298296 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-cb28b0c7-07a2-4185-85cd-e808926a3b64 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:56.298296 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-cb28b0c7-07a2-4185-85cd-e808926a3b64 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:56.331632 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-cb28b0c7-07a2-4185-85cd-e808926a3b64 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:56.332086 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-cb28b0c7-07a2-4185-85cd-e808926a3b64 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:56.332578 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.objects.instance [None req-cb28b0c7-07a2-4185-85cd-e808926a3b64 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lazy-loading 'fault' on Instance uuid 45f65f98-e1ca-4e07-872a-ef0403e2d50a {{(pid=118157) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 14:46:56.373662 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-cb28b0c7-07a2-4185-85cd-e808926a3b64 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48bbf88b32774d5da9ef93ac75686c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e80aa19d008640df9a1f924a7c03f7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:46:56.381098 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-cb28b0c7-07a2-4185-85cd-e808926a3b64 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/45f65f98-e1ca-4e07-872a-ef0403e2d50a" status: 200 len: 1312 microversion: 2.1 time: 0.095863 Jun 07 14:46:56.381661 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 367/744] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:46:56 2022] GET /compute/v2.1/servers/45f65f98-e1ca-4e07-872a-ef0403e2d50a => generated 1312 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:46:56.582107 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-5baad0f1-dbea-4fd0-abd9-da67dbc6a0c0 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:46:56.582748 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-5baad0f1-dbea-4fd0-abd9-da67dbc6a0c0 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:46:56.589710 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5baad0f1-dbea-4fd0-abd9-da67dbc6a0c0 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:56.596265 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5baad0f1-dbea-4fd0-abd9-da67dbc6a0c0 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:56.596265 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5baad0f1-dbea-4fd0-abd9-da67dbc6a0c0 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:56.596265 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5baad0f1-dbea-4fd0-abd9-da67dbc6a0c0 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:56.628439 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5baad0f1-dbea-4fd0-abd9-da67dbc6a0c0 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:56.628794 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5baad0f1-dbea-4fd0-abd9-da67dbc6a0c0 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:56.629245 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.objects.instance [None req-5baad0f1-dbea-4fd0-abd9-da67dbc6a0c0 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lazy-loading 'fault' on Instance uuid e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 {{(pid=118158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 14:46:56.672585 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-5baad0f1-dbea-4fd0-abd9-da67dbc6a0c0 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb4b0cf5f8b4274b787f327793964f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ba26b86c7243dab8e6c6b84ed674e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:46:56.679961 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-5baad0f1-dbea-4fd0-abd9-da67dbc6a0c0 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6" status: 200 len: 1328 microversion: 2.1 time: 0.101840 Jun 07 14:46:56.680534 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 378/745] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:46:56 2022] GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 => generated 1328 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:46:56.913943 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-5c2f9fee-84b6-44d0-97fc-457de011acbd tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:46:56.914562 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-5c2f9fee-84b6-44d0-97fc-457de011acbd tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: 89db7091-f026-4913-962e-ad45fd38b468] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:46:56.916621 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG dbcounter [-] [118157] Writing DB stats nova_cell0:SELECT=6 {{(pid=118157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:46:56.922075 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-5c2f9fee-84b6-44d0-97fc-457de011acbd tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:56.922532 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-5c2f9fee-84b6-44d0-97fc-457de011acbd tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:56.923307 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-5c2f9fee-84b6-44d0-97fc-457de011acbd tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:56.923750 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-5c2f9fee-84b6-44d0-97fc-457de011acbd tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:57.050601 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-5c2f9fee-84b6-44d0-97fc-457de011acbd tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:46:57.058534 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-5c2f9fee-84b6-44d0-97fc-457de011acbd tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:46:57.059964 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-5c2f9fee-84b6-44d0-97fc-457de011acbd tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:46:57.061105 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-5c2f9fee-84b6-44d0-97fc-457de011acbd tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468" status: 200 len: 1404 microversion: 2.20 time: 0.151963 Jun 07 14:46:57.061650 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 368/746] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:46:56 2022] GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468 => generated 1404 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:46:57.172015 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-5e488e8d-e5b3-4cc7-b14b-33578de0ad8a tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:46:57.172576 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-5e488e8d-e5b3-4cc7-b14b-33578de0ad8a tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: bac69e34-ec55-4f0b-8856-8411fe7ea17a] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:46:57.178949 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5e488e8d-e5b3-4cc7-b14b-33578de0ad8a tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:57.179407 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5e488e8d-e5b3-4cc7-b14b-33578de0ad8a tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:57.180176 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5e488e8d-e5b3-4cc7-b14b-33578de0ad8a tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:57.180632 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5e488e8d-e5b3-4cc7-b14b-33578de0ad8a tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:57.314205 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-5e488e8d-e5b3-4cc7-b14b-33578de0ad8a tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15f5fa82414bdf8ca3f6723c0a8d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e877695d0f46339cb4b9b86aac3662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:46:57.322356 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-5e488e8d-e5b3-4cc7-b14b-33578de0ad8a tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "GET /compute/v2.1/servers/bac69e34-ec55-4f0b-8856-8411fe7ea17a" status: 200 len: 1576 microversion: 2.1 time: 0.154226 Jun 07 14:46:57.322921 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 379/747] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:46:57 2022] GET /compute/v2.1/servers/bac69e34-ec55-4f0b-8856-8411fe7ea17a => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:46:57.400251 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-d9dbc8bf-a201-4462-91b6-479897f66416 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:46:57.400607 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-d9dbc8bf-a201-4462-91b6-479897f66416 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] [instance: 45f65f98-e1ca-4e07-872a-ef0403e2d50a] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:46:57.406898 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-d9dbc8bf-a201-4462-91b6-479897f66416 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:57.407344 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-d9dbc8bf-a201-4462-91b6-479897f66416 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:57.408144 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-d9dbc8bf-a201-4462-91b6-479897f66416 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:57.408603 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-d9dbc8bf-a201-4462-91b6-479897f66416 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:57.421708 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.wsgi [None req-d9dbc8bf-a201-4462-91b6-479897f66416 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] HTTP exception thrown: Instance 45f65f98-e1ca-4e07-872a-ef0403e2d50a could not be found. Jun 07 14:46:57.423578 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-d9dbc8bf-a201-4462-91b6-479897f66416 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Request method failure captured: Jun 07 14:46:57.423578 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: request: GET /compute/v2.1/servers/45f65f98-e1ca-4e07-872a-ef0403e2d50a HTTP/1.1 Jun 07 14:46:57.423578 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Accept: application/json Jun 07 14:46:57.423578 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Accept-Encoding: identity Jun 07 14:46:57.423578 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Connection: close Jun 07 14:46:57.423578 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Content-Length: 0 Jun 07 14:46:57.423578 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Content-Type: application/json Jun 07 14:46:57.423578 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Host: 10.222.0.85 Jun 07 14:46:57.423578 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Openstack-System-Scope: None Jun 07 14:46:57.423578 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: User-Agent: python-urllib3/1.26.9 Jun 07 14:46:57.423578 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Auth-Token: gAAAAABin2MfoYDVhu2np0DRcQVNUXdKMfJ65XCHwNNgDzofb7UJB-BWXWBLWaEswfOjFb54DUFMtQxlwkMGgXmEQLjfj_mQyFqyWAiCHR0I3nl7bqHSoOmAgQ9B8P9sCJ5_1DmOjuYjvvS65ktGlA1sVBmQ3mMGWuAH2ULxrW_BKmx6e7vrexU Jun 07 14:46:57.423578 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Domain-Id: None Jun 07 14:46:57.423578 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Domain-Name: None Jun 07 14:46:57.423578 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Identity-Status: Confirmed Jun 07 14:46:57.423578 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Is-Admin-Project: True Jun 07 14:46:57.423578 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Project-Domain-Id: default Jun 07 14:46:57.423578 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Project-Domain-Name: Default Jun 07 14:46:57.423578 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Project-Id: e80aa19d008640df9a1f924a7c03f7f6 Jun 07 14:46:57.423578 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1172669914 Jun 07 14:46:57.423578 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Role: member,reader Jun 07 14:46:57.423578 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Roles: member,reader Jun 07 14:46:57.425806 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e80aa19d008640df9a1f924a7c03f7f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_e80aa19d008640df9a1f924a7c03f7f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e80aa19d008640df9a1f924a7c03f7f6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/e80aa19d008640df9a1f924a7c03f7f6"}]}] Jun 07 14:46:57.425806 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1172669914 Jun 07 14:46:57.425806 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Tenant-Id: e80aa19d008640df9a1f924a7c03f7f6 Jun 07 14:46:57.425806 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1172669914 Jun 07 14:46:57.425806 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User: tempest-ServerRescueNegativeTestJSON-1172669914-project Jun 07 14:46:57.425806 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User-Domain-Id: default Jun 07 14:46:57.425806 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User-Domain-Name: Default Jun 07 14:46:57.425806 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User-Id: 48bbf88b32774d5da9ef93ac75686c34 Jun 07 14:46:57.425806 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1172669914-project Jun 07 14:46:57.425806 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: method: > Jun 07 14:46:57.425806 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: exception: Instance 45f65f98-e1ca-4e07-872a-ef0403e2d50a could not be found. Jun 07 14:46:57.425806 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: action_args: {'id': '45f65f98-e1ca-4e07-872a-ef0403e2d50a'} Jun 07 14:46:57.426715 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:46:57.426715 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:46:57.426715 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 14:46:57.426715 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 14:46:57.426715 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 14:46:57.426715 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 14:46:57.426715 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 14:46:57.426715 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 14:46:57.426715 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 14:46:57.426715 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 14:46:57.426715 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45f65f98-e1ca-4e07-872a-ef0403e2d50a could not be found. Jun 07 14:46:57.426715 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:46:57.426715 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:46:57.426715 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:46:57.426715 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:46:57.426715 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:46:57.426715 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:46:57.426715 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:46:57.426715 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:46:57.426715 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:46:57.428220 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:46:57.428220 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 14:46:57.428220 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 14:46:57.428220 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 14:46:57.428220 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 14:46:57.428220 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 14:46:57.428220 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:46:57.428220 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45f65f98-e1ca-4e07-872a-ef0403e2d50a could not be found. Jun 07 14:46:57.428220 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:46:57.428220 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:46:57.428220 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:46:57.428220 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:46:57.428220 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:46:57.428220 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:46:57.428220 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:46:57.428220 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:46:57.428220 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45f65f98-e1ca-4e07-872a-ef0403e2d50a could not be found. Jun 07 14:46:57.428220 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:46:57.429558 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-d9dbc8bf-a201-4462-91b6-479897f66416 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] Returning 404 to user: Instance 45f65f98-e1ca-4e07-872a-ef0403e2d50a could not be found. {{(pid=118157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:46:57.429558 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-d9dbc8bf-a201-4462-91b6-479897f66416 tempest-ServerRescueNegativeTestJSON-1172669914 tempest-ServerRescueNegativeTestJSON-1172669914-project] 10.222.0.85 "GET /compute/v2.1/servers/45f65f98-e1ca-4e07-872a-ef0403e2d50a" status: 404 len: 111 microversion: 2.1 time: 0.029993 Jun 07 14:46:57.429558 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 369/748] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:46:57 2022] GET /compute/v2.1/servers/45f65f98-e1ca-4e07-872a-ef0403e2d50a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 14:46:57.697761 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-8cc2ab1b-8b03-45d8-8716-106f51c8e1bb tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:46:57.698308 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-8cc2ab1b-8b03-45d8-8716-106f51c8e1bb tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:46:57.704706 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-8cc2ab1b-8b03-45d8-8716-106f51c8e1bb tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:57.705214 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-8cc2ab1b-8b03-45d8-8716-106f51c8e1bb tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:57.705998 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-8cc2ab1b-8b03-45d8-8716-106f51c8e1bb tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:57.707144 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-8cc2ab1b-8b03-45d8-8716-106f51c8e1bb tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:57.723097 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.wsgi [None req-8cc2ab1b-8b03-45d8-8716-106f51c8e1bb tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] HTTP exception thrown: Instance e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 could not be found. Jun 07 14:46:57.724994 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-8cc2ab1b-8b03-45d8-8716-106f51c8e1bb tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Request method failure captured: Jun 07 14:46:57.724994 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: request: GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 HTTP/1.1 Jun 07 14:46:57.724994 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Accept: application/json Jun 07 14:46:57.724994 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Accept-Encoding: identity Jun 07 14:46:57.724994 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Connection: close Jun 07 14:46:57.724994 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Content-Length: 0 Jun 07 14:46:57.724994 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Content-Type: application/json Jun 07 14:46:57.724994 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Host: 10.222.0.85 Jun 07 14:46:57.724994 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Openstack-System-Scope: None Jun 07 14:46:57.724994 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: User-Agent: python-urllib3/1.26.9 Jun 07 14:46:57.724994 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Auth-Token: gAAAAABin2Mdptwt2bm6Ygpvo1z07HA83GDKDacru9YSte997O9m3xiuuMufkDvVtfUolJbez-VskeP9fwc6GcGNbcXcUKLOn7jWNFG1YRk8n4-RNwJRsnaMq3LqApUiRgJ59ZeFndh0vNb-0kuvJIBCImSgZYyoqwtghJVYN2X11w1VavHgQyM Jun 07 14:46:57.724994 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Domain-Id: None Jun 07 14:46:57.724994 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Domain-Name: None Jun 07 14:46:57.724994 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Identity-Status: Confirmed Jun 07 14:46:57.724994 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Is-Admin-Project: True Jun 07 14:46:57.724994 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Domain-Id: default Jun 07 14:46:57.724994 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Domain-Name: Default Jun 07 14:46:57.724994 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Id: 97ba26b86c7243dab8e6c6b84ed674e8 Jun 07 14:46:57.724994 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Name: tempest-AttachVolumeTestJSON-126212865 Jun 07 14:46:57.724994 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Role: member,reader Jun 07 14:46:57.724994 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Roles: member,reader Jun 07 14:46:57.726455 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/97ba26b86c7243dab8e6c6b84ed674e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_97ba26b86c7243dab8e6c6b84ed674e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/97ba26b86c7243dab8e6c6b84ed674e8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/97ba26b86c7243dab8e6c6b84ed674e8"}]}] Jun 07 14:46:57.726455 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Tenant: tempest-AttachVolumeTestJSON-126212865 Jun 07 14:46:57.726455 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Tenant-Id: 97ba26b86c7243dab8e6c6b84ed674e8 Jun 07 14:46:57.726455 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Tenant-Name: tempest-AttachVolumeTestJSON-126212865 Jun 07 14:46:57.726455 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User: tempest-AttachVolumeTestJSON-126212865-project Jun 07 14:46:57.726455 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Domain-Id: default Jun 07 14:46:57.726455 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Domain-Name: Default Jun 07 14:46:57.726455 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Id: 4fb4b0cf5f8b4274b787f327793964f3 Jun 07 14:46:57.726455 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Name: tempest-AttachVolumeTestJSON-126212865-project Jun 07 14:46:57.726455 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: method: > Jun 07 14:46:57.726455 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: exception: Instance e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 could not be found. Jun 07 14:46:57.726455 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: action_args: {'id': 'e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6'} Jun 07 14:46:57.727391 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:46:57.727391 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:46:57.727391 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 14:46:57.727391 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 14:46:57.727391 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 14:46:57.727391 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 14:46:57.727391 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 14:46:57.727391 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 14:46:57.727391 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 14:46:57.727391 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 14:46:57.727391 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 could not be found. Jun 07 14:46:57.727391 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:46:57.727391 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:46:57.727391 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:46:57.727391 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:46:57.727391 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:46:57.727391 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:46:57.727391 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:46:57.727391 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:46:57.727391 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:46:57.728635 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:46:57.728635 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 14:46:57.728635 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 14:46:57.728635 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 14:46:57.728635 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 14:46:57.728635 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 14:46:57.728635 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:46:57.728635 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 could not be found. Jun 07 14:46:57.728635 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:46:57.728635 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:46:57.728635 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:46:57.728635 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:46:57.728635 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:46:57.728635 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:46:57.728635 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:46:57.728635 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:46:57.728635 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 could not be found. Jun 07 14:46:57.728635 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:46:57.729676 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-8cc2ab1b-8b03-45d8-8716-106f51c8e1bb tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Returning 404 to user: Instance e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 could not be found. {{(pid=118158) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:46:57.729676 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-8cc2ab1b-8b03-45d8-8716-106f51c8e1bb tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6" status: 404 len: 111 microversion: 2.1 time: 0.033167 Jun 07 14:46:57.729676 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 380/749] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:46:57 2022] GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 14:46:57.735578 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-44c9fa93-3ce6-403e-91da-fd67bdd69d17 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '.version_select at 0x7f5f88053b80>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:46:57.742430 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG dbcounter [-] [118157] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=118157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:46:57.828496 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-44c9fa93-3ce6-403e-91da-fd67bdd69d17 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1077111204" status: 202 len: 0 microversion: 2.1 time: 0.096516 Jun 07 14:46:57.829616 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 370/750] 10.222.0.85 () {58 vars in 1220 bytes} [Tue Jun 7 14:46:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1077111204 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 07 14:46:58.079815 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-c6ed5bc0-005c-4f68-bd35-66e687f6a6df tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:46:58.080472 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-c6ed5bc0-005c-4f68-bd35-66e687f6a6df tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: 89db7091-f026-4913-962e-ad45fd38b468] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:46:58.087528 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-c6ed5bc0-005c-4f68-bd35-66e687f6a6df tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:58.088259 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-c6ed5bc0-005c-4f68-bd35-66e687f6a6df tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:58.089067 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-c6ed5bc0-005c-4f68-bd35-66e687f6a6df tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:58.089503 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-c6ed5bc0-005c-4f68-bd35-66e687f6a6df tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:58.344110 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-36342026-74cc-48aa-ac33-c377fbdac60d tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:46:58.344836 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-36342026-74cc-48aa-ac33-c377fbdac60d tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: bac69e34-ec55-4f0b-8856-8411fe7ea17a] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:46:58.351823 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-36342026-74cc-48aa-ac33-c377fbdac60d tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:58.352277 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-36342026-74cc-48aa-ac33-c377fbdac60d tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:58.353071 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-36342026-74cc-48aa-ac33-c377fbdac60d tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:58.353507 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-36342026-74cc-48aa-ac33-c377fbdac60d tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:58.357402 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG dbcounter [-] [118157] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:46:58.494741 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-36342026-74cc-48aa-ac33-c377fbdac60d tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15f5fa82414bdf8ca3f6723c0a8d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e877695d0f46339cb4b9b86aac3662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:46:58.505237 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-36342026-74cc-48aa-ac33-c377fbdac60d tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "GET /compute/v2.1/servers/bac69e34-ec55-4f0b-8856-8411fe7ea17a" status: 200 len: 1576 microversion: 2.1 time: 0.165714 Jun 07 14:46:58.505810 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 371/751] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:46:58 2022] GET /compute/v2.1/servers/bac69e34-ec55-4f0b-8856-8411fe7ea17a => generated 1576 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:46:58.537441 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-c6ed5bc0-005c-4f68-bd35-66e687f6a6df tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:46:58.545709 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-c6ed5bc0-005c-4f68-bd35-66e687f6a6df tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:46:58.547528 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-c6ed5bc0-005c-4f68-bd35-66e687f6a6df tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:46:58.548749 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-c6ed5bc0-005c-4f68-bd35-66e687f6a6df tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468" status: 200 len: 1404 microversion: 2.20 time: 0.473262 Jun 07 14:46:58.549373 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 381/752] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:46:58 2022] GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468 => generated 1404 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:46:59.412763 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-2960a1ac-fa86-439b-8e6b-583254c1ae39 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Action: 'create', calling method: .version_select at 0x7f5f82fcfe50>, body: {"keypair": {"name": "tempest-keypair-1383653833", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB/aoIKwehUrhj+oJtowaG4GNLA1WR3qv9RrcyoFdagYVc1+OeNcQJ+rkEoTlRLNp0iir416OaNuM9yXt1CtiBCmWWQ8n6OKVnnpa4186o/K2gR37Um0eh55QTDRZmi77A=="}} {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:46:59.429507 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.quota [None req-2960a1ac-fa86-439b-8e6b-583254c1ae39 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Getting quotas for project 97ba26b86c7243dab8e6c6b84ed674e8. Resources: {'key_pairs'} {{(pid=118157) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 14:46:59.433411 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.quota [None req-2960a1ac-fa86-439b-8e6b-583254c1ae39 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Getting quotas for user 4fb4b0cf5f8b4274b787f327793964f3 and project 97ba26b86c7243dab8e6c6b84ed674e8. Resources: {'key_pairs'} {{(pid=118157) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 14:46:59.523171 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-29b39e38-3eae-4121-b4f7-179ad7d5ebdd tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:46:59.524601 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-29b39e38-3eae-4121-b4f7-179ad7d5ebdd tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: bac69e34-ec55-4f0b-8856-8411fe7ea17a] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:46:59.532503 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-29b39e38-3eae-4121-b4f7-179ad7d5ebdd tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:59.533304 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-29b39e38-3eae-4121-b4f7-179ad7d5ebdd tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:59.534989 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-29b39e38-3eae-4121-b4f7-179ad7d5ebdd tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:59.535432 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-29b39e38-3eae-4121-b4f7-179ad7d5ebdd tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:59.543662 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-2960a1ac-fa86-439b-8e6b-583254c1ae39 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.136920 Jun 07 14:46:59.549257 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 372/753] 10.222.0.85 () {60 vars in 1158 bytes} [Tue Jun 7 14:46:59 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:46:59.567558 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-d77dcee1-9fcb-4f3c-8900-31b8f7b85721 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:46:59.568195 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-d77dcee1-9fcb-4f3c-8900-31b8f7b85721 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: 89db7091-f026-4913-962e-ad45fd38b468] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:46:59.578108 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-d77dcee1-9fcb-4f3c-8900-31b8f7b85721 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:59.578842 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-d77dcee1-9fcb-4f3c-8900-31b8f7b85721 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:59.580672 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-d77dcee1-9fcb-4f3c-8900-31b8f7b85721 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:46:59.582006 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-d77dcee1-9fcb-4f3c-8900-31b8f7b85721 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:46:59.652540 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-29b39e38-3eae-4121-b4f7-179ad7d5ebdd tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15f5fa82414bdf8ca3f6723c0a8d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e877695d0f46339cb4b9b86aac3662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:46:59.662746 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-29b39e38-3eae-4121-b4f7-179ad7d5ebdd tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "GET /compute/v2.1/servers/bac69e34-ec55-4f0b-8856-8411fe7ea17a" status: 200 len: 1508 microversion: 2.1 time: 0.143968 Jun 07 14:46:59.663460 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 382/754] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:46:59 2022] GET /compute/v2.1/servers/bac69e34-ec55-4f0b-8856-8411fe7ea17a => generated 1508 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:46:59.822389 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-d77dcee1-9fcb-4f3c-8900-31b8f7b85721 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:46:59.835106 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-d77dcee1-9fcb-4f3c-8900-31b8f7b85721 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:46:59.837032 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-d77dcee1-9fcb-4f3c-8900-31b8f7b85721 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:46:59.838550 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-d77dcee1-9fcb-4f3c-8900-31b8f7b85721 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468" status: 200 len: 1404 microversion: 2.20 time: 0.275176 Jun 07 14:46:59.850582 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 373/755] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:46:59 2022] GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468 => generated 1404 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 14:47:00.187900 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [req-26debffc-4954-474b-94f9-b2d9cba6e303 req-496e700c-0817-491b-85c1-f6f63e006f7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bac69e34-ec55-4f0b-8856-8411fe7ea17a", "name": "network-vif-deleted", "tag": "9c17af0a-e236-4760-ab4a-8f9ffaff1a14"}]} {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:47:00.197865 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [req-26debffc-4954-474b-94f9-b2d9cba6e303 req-496e700c-0817-491b-85c1-f6f63e006f7e service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:00.198306 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [req-26debffc-4954-474b-94f9-b2d9cba6e303 req-496e700c-0817-491b-85c1-f6f63e006f7e service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:00.211305 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.compute.server_external_events [req-26debffc-4954-474b-94f9-b2d9cba6e303 req-496e700c-0817-491b-85c1-f6f63e006f7e service nova] Creating event network-vif-deleted:9c17af0a-e236-4760-ab4a-8f9ffaff1a14 for instance bac69e34-ec55-4f0b-8856-8411fe7ea17a on hv-cinder-84497 Jun 07 14:47:00.217875 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [req-26debffc-4954-474b-94f9-b2d9cba6e303 req-496e700c-0817-491b-85c1-f6f63e006f7e service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034236 Jun 07 14:47:00.219486 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 383/756] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jun 7 14:47:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 14:47:00.272355 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [req-87b6e24d-d5f7-4e2a-afef-82be467c1089 req-c47d86f5-6718-43d1-8937-6f9ed009ae14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89db7091-f026-4913-962e-ad45fd38b468", "name": "network-vif-plugged", "status": "completed", "tag": "cf25b5fc-6d60-40d5-8461-593838e20baf"}]} {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:47:00.289023 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [req-87b6e24d-d5f7-4e2a-afef-82be467c1089 req-c47d86f5-6718-43d1-8937-6f9ed009ae14 service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:00.294249 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [req-87b6e24d-d5f7-4e2a-afef-82be467c1089 req-c47d86f5-6718-43d1-8937-6f9ed009ae14 service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:00.309791 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.compute.server_external_events [req-87b6e24d-d5f7-4e2a-afef-82be467c1089 req-c47d86f5-6718-43d1-8937-6f9ed009ae14 service nova] Creating event network-vif-plugged:cf25b5fc-6d60-40d5-8461-593838e20baf for instance 89db7091-f026-4913-962e-ad45fd38b468 on hv-cinder-84497 Jun 07 14:47:00.316540 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [req-87b6e24d-d5f7-4e2a-afef-82be467c1089 req-c47d86f5-6718-43d1-8937-6f9ed009ae14 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050107 Jun 07 14:47:00.317529 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 374/757] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jun 7 14:47:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:47:00.683196 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-9890b2d5-f2a9-4206-8718-e65974a5541a tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:47:00.684590 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-9890b2d5-f2a9-4206-8718-e65974a5541a tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: bac69e34-ec55-4f0b-8856-8411fe7ea17a] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:47:00.706707 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-9890b2d5-f2a9-4206-8718-e65974a5541a tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:00.707428 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-9890b2d5-f2a9-4206-8718-e65974a5541a tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:00.709049 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-9890b2d5-f2a9-4206-8718-e65974a5541a tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:00.709841 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-9890b2d5-f2a9-4206-8718-e65974a5541a tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:00.798742 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-9890b2d5-f2a9-4206-8718-e65974a5541a tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15f5fa82414bdf8ca3f6723c0a8d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e877695d0f46339cb4b9b86aac3662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:47:00.808721 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-9890b2d5-f2a9-4206-8718-e65974a5541a tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "GET /compute/v2.1/servers/bac69e34-ec55-4f0b-8856-8411fe7ea17a" status: 200 len: 1225 microversion: 2.1 time: 0.127911 Jun 07 14:47:00.808721 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 384/758] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:47:00 2022] GET /compute/v2.1/servers/bac69e34-ec55-4f0b-8856-8411fe7ea17a => generated 1225 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:47:00.866604 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-795aa40a-ed46-4624-aa5d-608e4d4cd800 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:47:00.868184 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-795aa40a-ed46-4624-aa5d-608e4d4cd800 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: 89db7091-f026-4913-962e-ad45fd38b468] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:47:00.876488 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-795aa40a-ed46-4624-aa5d-608e4d4cd800 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:00.877405 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-795aa40a-ed46-4624-aa5d-608e4d4cd800 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:00.879034 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-795aa40a-ed46-4624-aa5d-608e4d4cd800 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:00.880084 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-795aa40a-ed46-4624-aa5d-608e4d4cd800 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:01.096693 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-795aa40a-ed46-4624-aa5d-608e4d4cd800 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:47:01.105949 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-795aa40a-ed46-4624-aa5d-608e4d4cd800 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:47:01.107697 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-795aa40a-ed46-4624-aa5d-608e4d4cd800 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:47:01.109137 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-795aa40a-ed46-4624-aa5d-608e4d4cd800 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468" status: 200 len: 1404 microversion: 2.20 time: 0.251307 Jun 07 14:47:01.110341 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 375/759] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:47:00 2022] GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468 => generated 1404 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:47:01.823934 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-3570a4a5-d43a-41d0-bcda-82f4a3f848d2 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:47:01.824935 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-3570a4a5-d43a-41d0-bcda-82f4a3f848d2 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: bac69e34-ec55-4f0b-8856-8411fe7ea17a] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:47:01.833368 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-3570a4a5-d43a-41d0-bcda-82f4a3f848d2 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:01.833904 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-3570a4a5-d43a-41d0-bcda-82f4a3f848d2 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:01.834814 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-3570a4a5-d43a-41d0-bcda-82f4a3f848d2 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:01.835473 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-3570a4a5-d43a-41d0-bcda-82f4a3f848d2 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:01.866481 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-3570a4a5-d43a-41d0-bcda-82f4a3f848d2 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:01.867019 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-3570a4a5-d43a-41d0-bcda-82f4a3f848d2 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:01.867543 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.objects.instance [None req-3570a4a5-d43a-41d0-bcda-82f4a3f848d2 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lazy-loading 'fault' on Instance uuid bac69e34-ec55-4f0b-8856-8411fe7ea17a {{(pid=118158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 14:47:01.935710 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-3570a4a5-d43a-41d0-bcda-82f4a3f848d2 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15f5fa82414bdf8ca3f6723c0a8d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e877695d0f46339cb4b9b86aac3662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:47:01.952651 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-3570a4a5-d43a-41d0-bcda-82f4a3f848d2 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "GET /compute/v2.1/servers/bac69e34-ec55-4f0b-8856-8411fe7ea17a" status: 200 len: 1230 microversion: 2.1 time: 0.132294 Jun 07 14:47:01.953261 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 385/760] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:47:01 2022] GET /compute/v2.1/servers/bac69e34-ec55-4f0b-8856-8411fe7ea17a => generated 1230 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:47:02.129307 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-1abe4bfa-deca-4c68-b4c7-ba5e990c580b tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:47:02.130108 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-1abe4bfa-deca-4c68-b4c7-ba5e990c580b tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: 89db7091-f026-4913-962e-ad45fd38b468] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:47:02.137084 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-1abe4bfa-deca-4c68-b4c7-ba5e990c580b tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:02.137533 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-1abe4bfa-deca-4c68-b4c7-ba5e990c580b tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:02.138338 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-1abe4bfa-deca-4c68-b4c7-ba5e990c580b tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:02.138803 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-1abe4bfa-deca-4c68-b4c7-ba5e990c580b tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:02.566880 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-1abe4bfa-deca-4c68-b4c7-ba5e990c580b tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:47:02.579061 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-1abe4bfa-deca-4c68-b4c7-ba5e990c580b tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:47:02.586402 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-1abe4bfa-deca-4c68-b4c7-ba5e990c580b tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:47:02.588104 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-1abe4bfa-deca-4c68-b4c7-ba5e990c580b tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468" status: 200 len: 1404 microversion: 2.20 time: 0.463520 Jun 07 14:47:02.589299 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 376/761] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:47:02 2022] GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468 => generated 1404 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:47:02.821329 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-743fd577-e605-4e30-a90e-2e01384d028f tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1771994014", "imageRef": "7802ce25-d370-43a3-8d85-0257d644d539", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c15099ef-ea55-434f-a3ed-b2648cb19c55"}], "security_groups": [{"name": "tempest-securitygroup--1877694572"}], "key_name": "tempest-keypair-1383653833", "user_data": "}} {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:47:02.966694 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.network.neutron [None req-743fd577-e605-4e30-a90e-2e01384d028f tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] validate_networks() for [('c15099ef-ea55-434f-a3ed-b2648cb19c55', None, None, None, None, None)] {{(pid=118158) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 14:47:02.970468 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-ac50fd36-025d-4969-911f-4759ae4e16b1 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:47:02.970989 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-ac50fd36-025d-4969-911f-4759ae4e16b1 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: bac69e34-ec55-4f0b-8856-8411fe7ea17a] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:47:02.983313 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-ac50fd36-025d-4969-911f-4759ae4e16b1 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:02.983775 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-ac50fd36-025d-4969-911f-4759ae4e16b1 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:02.984599 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-ac50fd36-025d-4969-911f-4759ae4e16b1 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:02.985039 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-ac50fd36-025d-4969-911f-4759ae4e16b1 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:03.001266 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.wsgi [None req-ac50fd36-025d-4969-911f-4759ae4e16b1 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] HTTP exception thrown: Instance bac69e34-ec55-4f0b-8856-8411fe7ea17a could not be found. Jun 07 14:47:03.002927 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-ac50fd36-025d-4969-911f-4759ae4e16b1 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Request method failure captured: Jun 07 14:47:03.002927 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: request: GET /compute/v2.1/servers/bac69e34-ec55-4f0b-8856-8411fe7ea17a HTTP/1.1 Jun 07 14:47:03.002927 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Accept: application/json Jun 07 14:47:03.002927 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Accept-Encoding: identity Jun 07 14:47:03.002927 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Connection: close Jun 07 14:47:03.002927 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Content-Length: 0 Jun 07 14:47:03.002927 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Content-Type: application/json Jun 07 14:47:03.002927 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Host: 10.222.0.85 Jun 07 14:47:03.002927 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Openstack-System-Scope: None Jun 07 14:47:03.002927 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: User-Agent: python-urllib3/1.26.9 Jun 07 14:47:03.002927 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Auth-Token: gAAAAABin2PUqFwU0AvmOqgQNDY4J595fARbGRNudVshtvt4BECAbce2SeSyZ4ADP2Iau0xa-EhBJXaAKOTzJ6BR3V1eowASX2CJpSAhimVWcEo1dNqlj_TVzaqOJjEHBniJA_cMp1TlqS665UYoJ3dgIqGoQK7oDPSO8yRQ-fWSdwHmmcw0uR8 Jun 07 14:47:03.002927 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Domain-Id: None Jun 07 14:47:03.002927 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Domain-Name: None Jun 07 14:47:03.002927 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Identity-Status: Confirmed Jun 07 14:47:03.002927 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Is-Admin-Project: True Jun 07 14:47:03.002927 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Project-Domain-Id: default Jun 07 14:47:03.002927 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Project-Domain-Name: Default Jun 07 14:47:03.002927 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Project-Id: 93e877695d0f46339cb4b9b86aac3662 Jun 07 14:47:03.002927 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Project-Name: tempest-TestVolumeBootPattern-338121805 Jun 07 14:47:03.002927 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Role: member,reader Jun 07 14:47:03.002927 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Roles: member,reader Jun 07 14:47:03.004847 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/93e877695d0f46339cb4b9b86aac3662"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_93e877695d0f46339cb4b9b86aac3662"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/93e877695d0f46339cb4b9b86aac3662"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/93e877695d0f46339cb4b9b86aac3662"}]}] Jun 07 14:47:03.004847 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Tenant: tempest-TestVolumeBootPattern-338121805 Jun 07 14:47:03.004847 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Tenant-Id: 93e877695d0f46339cb4b9b86aac3662 Jun 07 14:47:03.004847 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Tenant-Name: tempest-TestVolumeBootPattern-338121805 Jun 07 14:47:03.004847 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User: tempest-TestVolumeBootPattern-338121805-project Jun 07 14:47:03.004847 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User-Domain-Id: default Jun 07 14:47:03.004847 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User-Domain-Name: Default Jun 07 14:47:03.004847 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User-Id: 0a15f5fa82414bdf8ca3f6723c0a8d2d Jun 07 14:47:03.004847 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User-Name: tempest-TestVolumeBootPattern-338121805-project Jun 07 14:47:03.004847 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: method: > Jun 07 14:47:03.004847 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: exception: Instance bac69e34-ec55-4f0b-8856-8411fe7ea17a could not be found. Jun 07 14:47:03.004847 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: action_args: {'id': 'bac69e34-ec55-4f0b-8856-8411fe7ea17a'} Jun 07 14:47:03.005641 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:47:03.005641 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:47:03.005641 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 14:47:03.005641 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 14:47:03.005641 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 14:47:03.005641 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 14:47:03.005641 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 14:47:03.005641 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 14:47:03.005641 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 14:47:03.005641 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 14:47:03.005641 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bac69e34-ec55-4f0b-8856-8411fe7ea17a could not be found. Jun 07 14:47:03.005641 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:47:03.005641 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:47:03.005641 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:47:03.005641 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:47:03.005641 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:47:03.005641 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:47:03.005641 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:47:03.005641 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:47:03.005641 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:47:03.007296 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:47:03.007296 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 14:47:03.007296 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 14:47:03.007296 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 14:47:03.007296 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 14:47:03.007296 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 14:47:03.007296 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:47:03.007296 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bac69e34-ec55-4f0b-8856-8411fe7ea17a could not be found. Jun 07 14:47:03.007296 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:47:03.007296 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:47:03.007296 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:47:03.007296 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:47:03.007296 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:47:03.007296 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:47:03.007296 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:47:03.007296 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:47:03.007296 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bac69e34-ec55-4f0b-8856-8411fe7ea17a could not be found. Jun 07 14:47:03.007296 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:47:03.008358 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-ac50fd36-025d-4969-911f-4759ae4e16b1 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Returning 404 to user: Instance bac69e34-ec55-4f0b-8856-8411fe7ea17a could not be found. {{(pid=118157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:47:03.008358 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-ac50fd36-025d-4969-911f-4759ae4e16b1 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "GET /compute/v2.1/servers/bac69e34-ec55-4f0b-8856-8411fe7ea17a" status: 404 len: 111 microversion: 2.1 time: 0.039206 Jun 07 14:47:03.014688 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 377/762] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:47:02 2022] GET /compute/v2.1/servers/bac69e34-ec55-4f0b-8856-8411fe7ea17a => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 07 14:47:03.124335 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-46434164-32be-41eb-8b84-321946ab5192 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1339167280", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1252179120", "security_groups": [{"name": "tempest-secgroup-smoke-1421120797"}], "block_device_mapping_v2": [{"uuid": "d01b267c-9b0d-4a60-9afc-26bd7910eecc", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b46e8eee-36c4-4173-8e97-a52c3b403e49"}]}} {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:47:03.247501 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.network.neutron [None req-46434164-32be-41eb-8b84-321946ab5192 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] validate_networks() for [('b46e8eee-36c4-4173-8e97-a52c3b403e49', None, None, None, None, None)] {{(pid=118157) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 14:47:03.559134 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.virt.hardware [None req-743fd577-e605-4e30-a90e-2e01384d028f tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Flavor limits 0:0:0 {{(pid=118158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 14:47:03.559565 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.virt.hardware [None req-743fd577-e605-4e30-a90e-2e01384d028f tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Image limits 0:0:0 {{(pid=118158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 14:47:03.560041 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.virt.hardware [None req-743fd577-e605-4e30-a90e-2e01384d028f tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Flavor pref 0:0:0 {{(pid=118158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 14:47:03.560499 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.virt.hardware [None req-743fd577-e605-4e30-a90e-2e01384d028f tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Image pref 0:0:0 {{(pid=118158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 14:47:03.560917 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.virt.hardware [None req-743fd577-e605-4e30-a90e-2e01384d028f tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 14:47:03.571505 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-743fd577-e605-4e30-a90e-2e01384d028f tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:03.571949 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-743fd577-e605-4e30-a90e-2e01384d028f tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:03.572786 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-743fd577-e605-4e30-a90e-2e01384d028f tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:03.573225 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-743fd577-e605-4e30-a90e-2e01384d028f tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:03.590199 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.quota [None req-743fd577-e605-4e30-a90e-2e01384d028f tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Getting quotas for project 97ba26b86c7243dab8e6c6b84ed674e8. Resources: {'instances', 'cores', 'ram'} {{(pid=118158) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 14:47:03.594376 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.quota [None req-743fd577-e605-4e30-a90e-2e01384d028f tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Getting quotas for user 4fb4b0cf5f8b4274b787f327793964f3 and project 97ba26b86c7243dab8e6c6b84ed674e8. Resources: {'instances', 'cores', 'ram'} {{(pid=118158) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 14:47:03.607652 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-743fd577-e605-4e30-a90e-2e01384d028f tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Going to run 1 instances... {{(pid=118158) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 14:47:03.609958 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-743fd577-e605-4e30-a90e-2e01384d028f tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e038fb54-192d-4af5-a273-955b1493d4b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7802ce25-d370-43a3-8d85-0257d644d539',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118158) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 14:47:03.634405 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.virt.hardware [None req-46434164-32be-41eb-8b84-321946ab5192 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Flavor limits 0:0:0 {{(pid=118157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 14:47:03.634840 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.virt.hardware [None req-46434164-32be-41eb-8b84-321946ab5192 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Image limits 0:0:0 {{(pid=118157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 14:47:03.635313 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.virt.hardware [None req-46434164-32be-41eb-8b84-321946ab5192 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Flavor pref 0:0:0 {{(pid=118157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 14:47:03.635725 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.virt.hardware [None req-46434164-32be-41eb-8b84-321946ab5192 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Image pref 0:0:0 {{(pid=118157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 14:47:03.636802 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.virt.hardware [None req-46434164-32be-41eb-8b84-321946ab5192 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 14:47:03.646405 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-46434164-32be-41eb-8b84-321946ab5192 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:03.647114 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-46434164-32be-41eb-8b84-321946ab5192 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:03.647922 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-46434164-32be-41eb-8b84-321946ab5192 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:03.648357 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-46434164-32be-41eb-8b84-321946ab5192 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:03.665438 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.quota [None req-46434164-32be-41eb-8b84-321946ab5192 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Getting quotas for project 93e877695d0f46339cb4b9b86aac3662. Resources: {'instances', 'cores', 'ram'} {{(pid=118157) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 14:47:03.669570 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.quota [None req-46434164-32be-41eb-8b84-321946ab5192 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Getting quotas for user 0a15f5fa82414bdf8ca3f6723c0a8d2d and project 93e877695d0f46339cb4b9b86aac3662. Resources: {'instances', 'cores', 'ram'} {{(pid=118157) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 14:47:03.728167 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-46434164-32be-41eb-8b84-321946ab5192 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Going to run 1 instances... {{(pid=118157) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 14:47:03.728167 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-46434164-32be-41eb-8b84-321946ab5192 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: c7578860-5e31-48e5-8a70-7c6bad9afe91] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d01b267c-9b0d-4a60-9afc-26bd7910eecc',volume_size=None,volume_type=None)] {{(pid=118157) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 14:47:03.766223 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-743fd577-e605-4e30-a90e-2e01384d028f tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.949062 Jun 07 14:47:03.766851 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 386/763] 10.222.0.85 () {60 vars in 1146 bytes} [Tue Jun 7 14:47:02 2022] POST /compute/v2.1/servers => generated 402 bytes in 950 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 07 14:47:03.777329 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-7b399675-9d0d-4fae-b044-6ff7eef8ba36 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:47:03.777925 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-7b399675-9d0d-4fae-b044-6ff7eef8ba36 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: 89db7091-f026-4913-962e-ad45fd38b468] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:47:03.783972 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-7b399675-9d0d-4fae-b044-6ff7eef8ba36 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:03.791339 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-7b399675-9d0d-4fae-b044-6ff7eef8ba36 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:03.791339 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-7b399675-9d0d-4fae-b044-6ff7eef8ba36 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:03.791339 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-7b399675-9d0d-4fae-b044-6ff7eef8ba36 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:03.927642 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-7b399675-9d0d-4fae-b044-6ff7eef8ba36 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:47:03.949380 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-7b399675-9d0d-4fae-b044-6ff7eef8ba36 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:47:03.960018 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-7b399675-9d0d-4fae-b044-6ff7eef8ba36 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:47:03.960018 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-7b399675-9d0d-4fae-b044-6ff7eef8ba36 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468" status: 200 len: 1596 microversion: 2.20 time: 0.182828 Jun 07 14:47:03.960018 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 387/764] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:47:03 2022] GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468 => generated 1596 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:47:03.965980 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-026bf864-6572-46d0-8273-5a2238cf63a4 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:47:03.967186 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-026bf864-6572-46d0-8273-5a2238cf63a4 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e038fb54-192d-4af5-a273-955b1493d4b4] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:47:04.031060 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-026bf864-6572-46d0-8273-5a2238cf63a4 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb4b0cf5f8b4274b787f327793964f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ba26b86c7243dab8e6c6b84ed674e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:47:04.038822 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-026bf864-6572-46d0-8273-5a2238cf63a4 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e038fb54-192d-4af5-a273-955b1493d4b4" status: 200 len: 1238 microversion: 2.1 time: 0.080018 Jun 07 14:47:04.039465 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 388/765] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:47:03 2022] GET /compute/v2.1/servers/e038fb54-192d-4af5-a273-955b1493d4b4 => generated 1238 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:47:04.044304 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-ba3f6f60-40f0-43c6-b319-da6176d67cfb tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:47:04.044999 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-ba3f6f60-40f0-43c6-b319-da6176d67cfb tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: 89db7091-f026-4913-962e-ad45fd38b468] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:47:04.056568 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-ba3f6f60-40f0-43c6-b319-da6176d67cfb tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:04.057409 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-ba3f6f60-40f0-43c6-b319-da6176d67cfb tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:04.058885 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-ba3f6f60-40f0-43c6-b319-da6176d67cfb tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:04.059817 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-ba3f6f60-40f0-43c6-b319-da6176d67cfb tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:04.159044 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-ba3f6f60-40f0-43c6-b319-da6176d67cfb tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.111617 Jun 07 14:47:04.159044 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 389/766] 10.222.0.85 () {60 vars in 1315 bytes} [Tue Jun 7 14:47:04 2022] GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468/os-interface => generated 284 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 14:47:04.193333 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-46434164-32be-41eb-8b84-321946ab5192 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.072845 Jun 07 14:47:04.194258 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 378/767] 10.222.0.85 () {60 vars in 1146 bytes} [Tue Jun 7 14:47:03 2022] POST /compute/v2.1/servers => generated 406 bytes in 1074 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 07 14:47:04.203811 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-5eff7f81-204c-4ffc-a898-99b6a381a12c tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:47:04.208520 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-5eff7f81-204c-4ffc-a898-99b6a381a12c tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: c7578860-5e31-48e5-8a70-7c6bad9afe91] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:47:04.286091 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-5eff7f81-204c-4ffc-a898-99b6a381a12c tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15f5fa82414bdf8ca3f6723c0a8d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e877695d0f46339cb4b9b86aac3662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:47:04.293155 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-5eff7f81-204c-4ffc-a898-99b6a381a12c tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "GET /compute/v2.1/servers/c7578860-5e31-48e5-8a70-7c6bad9afe91" status: 200 len: 1095 microversion: 2.1 time: 0.093031 Jun 07 14:47:04.294336 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 390/768] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:47:04 2022] GET /compute/v2.1/servers/c7578860-5e31-48e5-8a70-7c6bad9afe91 => generated 1095 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:47:05.056275 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-e966f144-bae7-4e75-8e59-67d91349809c tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:47:05.056933 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-e966f144-bae7-4e75-8e59-67d91349809c tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e038fb54-192d-4af5-a273-955b1493d4b4] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:47:05.063268 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-e966f144-bae7-4e75-8e59-67d91349809c tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:05.063719 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-e966f144-bae7-4e75-8e59-67d91349809c tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:05.064521 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-e966f144-bae7-4e75-8e59-67d91349809c tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:05.065085 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-e966f144-bae7-4e75-8e59-67d91349809c tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:05.130541 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-e966f144-bae7-4e75-8e59-67d91349809c tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb4b0cf5f8b4274b787f327793964f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ba26b86c7243dab8e6c6b84ed674e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:47:05.138575 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-e966f144-bae7-4e75-8e59-67d91349809c tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e038fb54-192d-4af5-a273-955b1493d4b4" status: 200 len: 1242 microversion: 2.1 time: 0.086396 Jun 07 14:47:05.139144 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 379/769] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:47:05 2022] GET /compute/v2.1/servers/e038fb54-192d-4af5-a273-955b1493d4b4 => generated 1242 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:47:05.306913 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [req-9c3f8473-5502-4980-be76-4295c8d5a379 req-43f87ed1-0485-46e7-bec8-3764e1285d6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89db7091-f026-4913-962e-ad45fd38b468", "tag": "cf25b5fc-6d60-40d5-8461-593838e20baf"}]} {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:47:05.316294 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [req-9c3f8473-5502-4980-be76-4295c8d5a379 req-43f87ed1-0485-46e7-bec8-3764e1285d6c service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:05.317183 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [req-9c3f8473-5502-4980-be76-4295c8d5a379 req-43f87ed1-0485-46e7-bec8-3764e1285d6c service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:05.329101 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.compute.server_external_events [req-9c3f8473-5502-4980-be76-4295c8d5a379 req-43f87ed1-0485-46e7-bec8-3764e1285d6c service nova] Creating event network-changed:cf25b5fc-6d60-40d5-8461-593838e20baf for instance 89db7091-f026-4913-962e-ad45fd38b468 on hv-cinder-84497 Jun 07 14:47:05.338850 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [req-9c3f8473-5502-4980-be76-4295c8d5a379 req-43f87ed1-0485-46e7-bec8-3764e1285d6c service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037102 Jun 07 14:47:05.339699 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 380/770] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jun 7 14:47:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 14:47:05.346109 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-9c5508d1-f369-4daf-b7fe-f379851077b2 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:47:05.350232 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-9c5508d1-f369-4daf-b7fe-f379851077b2 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: c7578860-5e31-48e5-8a70-7c6bad9afe91] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:47:05.354343 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-9c5508d1-f369-4daf-b7fe-f379851077b2 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:05.355043 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-9c5508d1-f369-4daf-b7fe-f379851077b2 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:05.355838 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-9c5508d1-f369-4daf-b7fe-f379851077b2 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:05.356352 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-9c5508d1-f369-4daf-b7fe-f379851077b2 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:05.436049 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-9c5508d1-f369-4daf-b7fe-f379851077b2 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15f5fa82414bdf8ca3f6723c0a8d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e877695d0f46339cb4b9b86aac3662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:47:05.445477 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-9c5508d1-f369-4daf-b7fe-f379851077b2 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "GET /compute/v2.1/servers/c7578860-5e31-48e5-8a70-7c6bad9afe91" status: 200 len: 1145 microversion: 2.1 time: 0.104309 Jun 07 14:47:05.447333 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 381/771] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:47:05 2022] GET /compute/v2.1/servers/c7578860-5e31-48e5-8a70-7c6bad9afe91 => generated 1145 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:47:05.454217 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-4fa6d85f-dcbe-4b19-9506-ba0eeb171472 tempest-VolumesGetTestJSON-2146212534 tempest-VolumesGetTestJSON-2146212534-project] Action: 'create', calling method: .version_select at 0x7f5f826df1f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-703547435", "metadata": {"Type": "work"}}} {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:47:06.155966 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-3a1ebbae-6d10-4791-a096-501b53e80115 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:47:06.157301 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-3a1ebbae-6d10-4791-a096-501b53e80115 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e038fb54-192d-4af5-a273-955b1493d4b4] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:47:06.167097 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-3a1ebbae-6d10-4791-a096-501b53e80115 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:06.167799 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-3a1ebbae-6d10-4791-a096-501b53e80115 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:06.168921 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-3a1ebbae-6d10-4791-a096-501b53e80115 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:06.169638 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-3a1ebbae-6d10-4791-a096-501b53e80115 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:06.237361 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-3a1ebbae-6d10-4791-a096-501b53e80115 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb4b0cf5f8b4274b787f327793964f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ba26b86c7243dab8e6c6b84ed674e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:47:06.248456 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-3a1ebbae-6d10-4791-a096-501b53e80115 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e038fb54-192d-4af5-a273-955b1493d4b4" status: 200 len: 1298 microversion: 2.1 time: 0.096395 Jun 07 14:47:06.249439 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 382/772] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:47:06 2022] GET /compute/v2.1/servers/e038fb54-192d-4af5-a273-955b1493d4b4 => generated 1298 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:47:06.302735 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-4fa6d85f-dcbe-4b19-9506-ba0eeb171472 tempest-VolumesGetTestJSON-2146212534 tempest-VolumesGetTestJSON-2146212534-project] 10.222.0.85 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 1.007580 Jun 07 14:47:06.303465 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 391/773] 10.222.0.85 () {60 vars in 1155 bytes} [Tue Jun 7 14:47:05 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 1009 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jun 07 14:47:06.314195 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-1fe86660-6907-4cb0-95f3-5d2049d6f0f9 tempest-VolumesGetTestJSON-2146212534 tempest-VolumesGetTestJSON-2146212534-project] Calling method '.version_select at 0x7f5f880b2ca0>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:47:06.384946 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-1fe86660-6907-4cb0-95f3-5d2049d6f0f9 tempest-VolumesGetTestJSON-2146212534 tempest-VolumesGetTestJSON-2146212534-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/9d11375e-a1f8-449a-9670-430a7f664eff" status: 200 len: 352 microversion: 2.1 time: 0.074286 Jun 07 14:47:06.397173 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 383/774] 10.222.0.85 () {58 vars in 1244 bytes} [Tue Jun 7 14:47:06 2022] GET /compute/v2.1/os-volumes/9d11375e-a1f8-449a-9670-430a7f664eff => generated 352 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:47:06.463704 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-6a622a6b-48d8-49f2-8c49-30f7a2f4a04e tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:47:06.464328 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-6a622a6b-48d8-49f2-8c49-30f7a2f4a04e tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: c7578860-5e31-48e5-8a70-7c6bad9afe91] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:47:06.472592 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-6a622a6b-48d8-49f2-8c49-30f7a2f4a04e tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:06.473331 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-6a622a6b-48d8-49f2-8c49-30f7a2f4a04e tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:06.474915 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-6a622a6b-48d8-49f2-8c49-30f7a2f4a04e tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:06.475835 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-6a622a6b-48d8-49f2-8c49-30f7a2f4a04e tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:06.545068 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-6a622a6b-48d8-49f2-8c49-30f7a2f4a04e tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15f5fa82414bdf8ca3f6723c0a8d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e877695d0f46339cb4b9b86aac3662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:47:06.554228 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-6a622a6b-48d8-49f2-8c49-30f7a2f4a04e tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "GET /compute/v2.1/servers/c7578860-5e31-48e5-8a70-7c6bad9afe91" status: 200 len: 1193 microversion: 2.1 time: 0.094459 Jun 07 14:47:06.555007 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 392/775] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:47:06 2022] GET /compute/v2.1/servers/c7578860-5e31-48e5-8a70-7c6bad9afe91 => generated 1193 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:47:07.266560 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-e38ea8c2-91ac-48e3-add5-7d2d273975fc tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:47:07.267295 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-e38ea8c2-91ac-48e3-add5-7d2d273975fc tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e038fb54-192d-4af5-a273-955b1493d4b4] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:47:07.275273 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-e38ea8c2-91ac-48e3-add5-7d2d273975fc tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:07.275733 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-e38ea8c2-91ac-48e3-add5-7d2d273975fc tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:07.276904 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-e38ea8c2-91ac-48e3-add5-7d2d273975fc tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:07.277354 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-e38ea8c2-91ac-48e3-add5-7d2d273975fc tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:07.397860 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-c2b6cf58-0ab7-4e9a-bd78-8f3b09255130 tempest-VolumesGetTestJSON-2146212534 tempest-VolumesGetTestJSON-2146212534-project] Calling method '.version_select at 0x7f5f826df9d0>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:47:07.452799 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-c2b6cf58-0ab7-4e9a-bd78-8f3b09255130 tempest-VolumesGetTestJSON-2146212534 tempest-VolumesGetTestJSON-2146212534-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/9d11375e-a1f8-449a-9670-430a7f664eff" status: 200 len: 353 microversion: 2.1 time: 0.059742 Jun 07 14:47:07.453371 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 393/776] 10.222.0.85 () {58 vars in 1244 bytes} [Tue Jun 7 14:47:07 2022] GET /compute/v2.1/os-volumes/9d11375e-a1f8-449a-9670-430a7f664eff => generated 353 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 14:47:07.465594 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-29648f2e-0abb-4cac-94a0-72d32428ccac tempest-VolumesGetTestJSON-2146212534 tempest-VolumesGetTestJSON-2146212534-project] Calling method '.version_select at 0x7f5f826200d0>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:47:07.514475 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-e38ea8c2-91ac-48e3-add5-7d2d273975fc tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb4b0cf5f8b4274b787f327793964f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ba26b86c7243dab8e6c6b84ed674e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:47:07.530060 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-e38ea8c2-91ac-48e3-add5-7d2d273975fc tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e038fb54-192d-4af5-a273-955b1493d4b4" status: 200 len: 1364 microversion: 2.1 time: 0.268275 Jun 07 14:47:07.540797 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 384/777] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:47:07 2022] GET /compute/v2.1/servers/e038fb54-192d-4af5-a273-955b1493d4b4 => generated 1364 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:47:07.541619 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-29648f2e-0abb-4cac-94a0-72d32428ccac tempest-VolumesGetTestJSON-2146212534 tempest-VolumesGetTestJSON-2146212534-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/9d11375e-a1f8-449a-9670-430a7f664eff" status: 200 len: 353 microversion: 2.1 time: 0.079113 Jun 07 14:47:07.542373 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 394/778] 10.222.0.85 () {58 vars in 1244 bytes} [Tue Jun 7 14:47:07 2022] GET /compute/v2.1/os-volumes/9d11375e-a1f8-449a-9670-430a7f664eff => generated 353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:47:07.563052 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-388a2d67-6f45-496c-89ec-e60235357ed5 tempest-VolumesGetTestJSON-2146212534 tempest-VolumesGetTestJSON-2146212534-project] Calling method '.version_select at 0x7f5f880538b0>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:47:07.571980 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-0a8e3498-22f4-4049-bae6-907b7d95f813 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:47:07.572832 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-0a8e3498-22f4-4049-bae6-907b7d95f813 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: c7578860-5e31-48e5-8a70-7c6bad9afe91] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:47:07.581152 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-0a8e3498-22f4-4049-bae6-907b7d95f813 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:07.582224 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-0a8e3498-22f4-4049-bae6-907b7d95f813 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:07.583236 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-0a8e3498-22f4-4049-bae6-907b7d95f813 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:07.583800 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-0a8e3498-22f4-4049-bae6-907b7d95f813 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:07.806458 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-388a2d67-6f45-496c-89ec-e60235357ed5 tempest-VolumesGetTestJSON-2146212534 tempest-VolumesGetTestJSON-2146212534-project] 10.222.0.85 "DELETE /compute/v2.1/os-volumes/9d11375e-a1f8-449a-9670-430a7f664eff" status: 202 len: 0 microversion: 2.1 time: 0.247617 Jun 07 14:47:07.807147 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 385/779] 10.222.0.85 () {58 vars in 1247 bytes} [Tue Jun 7 14:47:07 2022] DELETE /compute/v2.1/os-volumes/9d11375e-a1f8-449a-9670-430a7f664eff => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 14:47:07.816653 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-e463f8c7-5ba7-4b50-8b9e-8b42cee03b75 tempest-VolumesGetTestJSON-2146212534 tempest-VolumesGetTestJSON-2146212534-project] Calling method '.version_select at 0x7f5f880b2d30>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:47:07.872405 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-e463f8c7-5ba7-4b50-8b9e-8b42cee03b75 tempest-VolumesGetTestJSON-2146212534 tempest-VolumesGetTestJSON-2146212534-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/9d11375e-a1f8-449a-9670-430a7f664eff" status: 200 len: 352 microversion: 2.1 time: 0.060956 Jun 07 14:47:07.872998 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 386/780] 10.222.0.85 () {58 vars in 1244 bytes} [Tue Jun 7 14:47:07 2022] GET /compute/v2.1/os-volumes/9d11375e-a1f8-449a-9670-430a7f664eff => generated 352 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:47:08.119089 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-0a8e3498-22f4-4049-bae6-907b7d95f813 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15f5fa82414bdf8ca3f6723c0a8d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e877695d0f46339cb4b9b86aac3662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:47:08.131016 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-0a8e3498-22f4-4049-bae6-907b7d95f813 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "GET /compute/v2.1/servers/c7578860-5e31-48e5-8a70-7c6bad9afe91" status: 200 len: 1279 microversion: 2.1 time: 0.563042 Jun 07 14:47:08.131995 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 395/781] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:47:07 2022] GET /compute/v2.1/servers/c7578860-5e31-48e5-8a70-7c6bad9afe91 => generated 1279 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:47:08.293375 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [req-23b05a9e-783c-4410-b2a9-3bbc4adb1cbd req-c287337d-5a1c-4982-a9aa-eb55dbee42d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e038fb54-192d-4af5-a273-955b1493d4b4", "tag": "00a49620-6acb-4d1d-8c32-f724d94ef876"}]} {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:47:08.306862 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [req-23b05a9e-783c-4410-b2a9-3bbc4adb1cbd req-c287337d-5a1c-4982-a9aa-eb55dbee42d9 service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:08.307317 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [req-23b05a9e-783c-4410-b2a9-3bbc4adb1cbd req-c287337d-5a1c-4982-a9aa-eb55dbee42d9 service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:08.330347 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.compute.server_external_events [req-23b05a9e-783c-4410-b2a9-3bbc4adb1cbd req-c287337d-5a1c-4982-a9aa-eb55dbee42d9 service nova] Creating event network-changed:00a49620-6acb-4d1d-8c32-f724d94ef876 for instance e038fb54-192d-4af5-a273-955b1493d4b4 on hv-cinder-84497 Jun 07 14:47:08.336868 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [req-23b05a9e-783c-4410-b2a9-3bbc4adb1cbd req-c287337d-5a1c-4982-a9aa-eb55dbee42d9 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047735 Jun 07 14:47:08.337704 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 387/782] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jun 7 14:47:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:47:08.549114 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-a265b803-bbbf-484b-8aad-65107e44e51d tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:47:08.553968 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-a265b803-bbbf-484b-8aad-65107e44e51d tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e038fb54-192d-4af5-a273-955b1493d4b4] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:47:08.569667 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-a265b803-bbbf-484b-8aad-65107e44e51d tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:08.570392 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-a265b803-bbbf-484b-8aad-65107e44e51d tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:08.571184 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-a265b803-bbbf-484b-8aad-65107e44e51d tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:08.571629 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-a265b803-bbbf-484b-8aad-65107e44e51d tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:08.767776 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-a265b803-bbbf-484b-8aad-65107e44e51d tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb4b0cf5f8b4274b787f327793964f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ba26b86c7243dab8e6c6b84ed674e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:47:08.776191 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-a265b803-bbbf-484b-8aad-65107e44e51d tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e038fb54-192d-4af5-a273-955b1493d4b4" status: 200 len: 1364 microversion: 2.1 time: 0.231714 Jun 07 14:47:08.777141 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 396/783] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:47:08 2022] GET /compute/v2.1/servers/e038fb54-192d-4af5-a273-955b1493d4b4 => generated 1364 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:47:08.885738 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-a30ec43b-44ff-4880-8d06-71ab8c4d9e12 tempest-VolumesGetTestJSON-2146212534 tempest-VolumesGetTestJSON-2146212534-project] Calling method '.version_select at 0x7f5f82fcfe50>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:47:08.914604 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.wsgi [None req-a30ec43b-44ff-4880-8d06-71ab8c4d9e12 tempest-VolumesGetTestJSON-2146212534 tempest-VolumesGetTestJSON-2146212534-project] HTTP exception thrown: Volume 9d11375e-a1f8-449a-9670-430a7f664eff could not be found. Jun 07 14:47:08.916709 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-a30ec43b-44ff-4880-8d06-71ab8c4d9e12 tempest-VolumesGetTestJSON-2146212534 tempest-VolumesGetTestJSON-2146212534-project] Request method failure captured: Jun 07 14:47:08.916709 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: request: GET /compute/v2.1/os-volumes/9d11375e-a1f8-449a-9670-430a7f664eff HTTP/1.1 Jun 07 14:47:08.916709 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Accept: application/json Jun 07 14:47:08.916709 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Accept-Encoding: identity Jun 07 14:47:08.916709 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Connection: close Jun 07 14:47:08.916709 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Content-Length: 0 Jun 07 14:47:08.916709 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Content-Type: application/json Jun 07 14:47:08.916709 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Host: 10.222.0.85 Jun 07 14:47:08.916709 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Openstack-System-Scope: None Jun 07 14:47:08.916709 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: User-Agent: python-urllib3/1.26.9 Jun 07 14:47:08.916709 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Auth-Token: gAAAAABin2TpOJPwk57nU7qEbXfGaQzGw-oW_PMqMU5Hp6Tzo0ZVf4Crvy70kdv_szB6i2foYtUz2JUS4G7PoxwkaqTgLqjAin5plpHlfTNu7VwJk7e_1108v_qpc0k_Px5UiJ9B2MMbPs9HGMSKbqeOJAQda6jAYURz4afkbdI0caLaaG3-fvQ Jun 07 14:47:08.916709 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Domain-Id: None Jun 07 14:47:08.916709 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Domain-Name: None Jun 07 14:47:08.916709 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Identity-Status: Confirmed Jun 07 14:47:08.916709 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Is-Admin-Project: True Jun 07 14:47:08.916709 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Project-Domain-Id: default Jun 07 14:47:08.916709 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Project-Domain-Name: Default Jun 07 14:47:08.916709 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Project-Id: 3d48db3fb13d4a98a2cf40c55cadcf50 Jun 07 14:47:08.916709 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Project-Name: tempest-VolumesGetTestJSON-2146212534 Jun 07 14:47:08.916709 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Role: member,reader Jun 07 14:47:08.916709 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Roles: member,reader Jun 07 14:47:08.918300 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3d48db3fb13d4a98a2cf40c55cadcf50"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_3d48db3fb13d4a98a2cf40c55cadcf50"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3d48db3fb13d4a98a2cf40c55cadcf50"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/3d48db3fb13d4a98a2cf40c55cadcf50"}]}] Jun 07 14:47:08.918300 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Tenant: tempest-VolumesGetTestJSON-2146212534 Jun 07 14:47:08.918300 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Tenant-Id: 3d48db3fb13d4a98a2cf40c55cadcf50 Jun 07 14:47:08.918300 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Tenant-Name: tempest-VolumesGetTestJSON-2146212534 Jun 07 14:47:08.918300 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User: tempest-VolumesGetTestJSON-2146212534-project Jun 07 14:47:08.918300 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User-Domain-Id: default Jun 07 14:47:08.918300 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User-Domain-Name: Default Jun 07 14:47:08.918300 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User-Id: 85ca0eb701f14e75a22a29681c1916a8 Jun 07 14:47:08.918300 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User-Name: tempest-VolumesGetTestJSON-2146212534-project Jun 07 14:47:08.918300 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: method: Jun 07 14:47:08.918300 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: exception: Volume 9d11375e-a1f8-449a-9670-430a7f664eff could not be found. Jun 07 14:47:08.918300 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: action_args: {'id': '9d11375e-a1f8-449a-9670-430a7f664eff'} Jun 07 14:47:08.918300 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:47:08.919467 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:47:08.919467 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 14:47:08.919467 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 14:47:08.919467 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 07 14:47:08.919467 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 07 14:47:08.919467 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 07 14:47:08.919467 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 07 14:47:08.919467 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 07 14:47:08.919467 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 07 14:47:08.919467 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 07 14:47:08.919467 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 07 14:47:08.919467 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 14:47:08.919467 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 14:47:08.919467 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 14:47:08.919467 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 14:47:08.919467 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9d11375e-a1f8-449a-9670-430a7f664eff could not be found. (HTTP 404) (Request-ID: req-ba4eda46-8fd1-4f1b-b936-753354531b26) Jun 07 14:47:08.919467 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:47:08.919467 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:47:08.919467 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:47:08.920995 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:47:08.920995 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 07 14:47:08.920995 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 07 14:47:08.920995 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 07 14:47:08.920995 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 07 14:47:08.920995 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 07 14:47:08.920995 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 07 14:47:08.920995 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 07 14:47:08.920995 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 07 14:47:08.920995 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 14:47:08.920995 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 14:47:08.920995 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 07 14:47:08.920995 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 07 14:47:08.920995 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 07 14:47:08.920995 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 07 14:47:08.920995 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 07 14:47:08.920995 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 07 14:47:08.920995 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 07 14:47:08.920995 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 07 14:47:08.922446 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 14:47:08.922446 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 14:47:08.922446 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 14:47:08.922446 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 14:47:08.922446 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9d11375e-a1f8-449a-9670-430a7f664eff could not be found. Jun 07 14:47:08.922446 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:47:08.922446 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:47:08.922446 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:47:08.922446 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:47:08.922446 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:47:08.922446 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:47:08.922446 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:47:08.922446 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:47:08.922446 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 14:47:08.922446 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 14:47:08.922446 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:47:08.922446 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:47:08.922446 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 07 14:47:08.922446 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:47:08.924428 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9d11375e-a1f8-449a-9670-430a7f664eff could not be found. Jun 07 14:47:08.924428 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:47:08.924428 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:47:08.924428 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:47:08.924428 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:47:08.924428 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:47:08.924428 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:47:08.924428 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:47:08.924428 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:47:08.924428 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9d11375e-a1f8-449a-9670-430a7f664eff could not be found. Jun 07 14:47:08.924428 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:47:08.924428 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-a30ec43b-44ff-4880-8d06-71ab8c4d9e12 tempest-VolumesGetTestJSON-2146212534 tempest-VolumesGetTestJSON-2146212534-project] Returning 404 to user: Volume 9d11375e-a1f8-449a-9670-430a7f664eff could not be found. {{(pid=118157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:47:08.924428 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-a30ec43b-44ff-4880-8d06-71ab8c4d9e12 tempest-VolumesGetTestJSON-2146212534 tempest-VolumesGetTestJSON-2146212534-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/9d11375e-a1f8-449a-9670-430a7f664eff" status: 404 len: 109 microversion: 2.1 time: 0.036878 Jun 07 14:47:08.924428 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 388/784] 10.222.0.85 () {58 vars in 1244 bytes} [Tue Jun 7 14:47:08 2022] GET /compute/v2.1/os-volumes/9d11375e-a1f8-449a-9670-430a7f664eff => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 14:47:08.988990 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [req-281a485c-3bea-4f8a-9b5c-72a9e1ad55d3 req-c5992b31-c9c3-4476-b6fe-38018749fa21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7578860-5e31-48e5-8a70-7c6bad9afe91", "tag": "a31fb889-4abe-498c-aa99-a0264a6ccf0a"}]} {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:47:08.999159 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [req-281a485c-3bea-4f8a-9b5c-72a9e1ad55d3 req-c5992b31-c9c3-4476-b6fe-38018749fa21 service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:08.999536 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [req-281a485c-3bea-4f8a-9b5c-72a9e1ad55d3 req-c5992b31-c9c3-4476-b6fe-38018749fa21 service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:09.020797 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.compute.server_external_events [req-281a485c-3bea-4f8a-9b5c-72a9e1ad55d3 req-c5992b31-c9c3-4476-b6fe-38018749fa21 service nova] Creating event network-changed:a31fb889-4abe-498c-aa99-a0264a6ccf0a for instance c7578860-5e31-48e5-8a70-7c6bad9afe91 on hv-cinder-84497 Jun 07 14:47:09.027495 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [req-281a485c-3bea-4f8a-9b5c-72a9e1ad55d3 req-c5992b31-c9c3-4476-b6fe-38018749fa21 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047324 Jun 07 14:47:09.028427 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 397/785] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jun 7 14:47:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:47:09.153995 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-01542d0b-30a8-4983-b41b-2cfb1cc90483 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:47:09.154930 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-01542d0b-30a8-4983-b41b-2cfb1cc90483 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: c7578860-5e31-48e5-8a70-7c6bad9afe91] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:47:09.164755 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-01542d0b-30a8-4983-b41b-2cfb1cc90483 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:09.164755 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-01542d0b-30a8-4983-b41b-2cfb1cc90483 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:09.164755 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-01542d0b-30a8-4983-b41b-2cfb1cc90483 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:09.165040 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-01542d0b-30a8-4983-b41b-2cfb1cc90483 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:09.321045 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-01542d0b-30a8-4983-b41b-2cfb1cc90483 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15f5fa82414bdf8ca3f6723c0a8d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e877695d0f46339cb4b9b86aac3662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:47:09.329915 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-01542d0b-30a8-4983-b41b-2cfb1cc90483 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "GET /compute/v2.1/servers/c7578860-5e31-48e5-8a70-7c6bad9afe91" status: 200 len: 1267 microversion: 2.1 time: 0.181872 Jun 07 14:47:09.330809 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 389/786] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:47:09 2022] GET /compute/v2.1/servers/c7578860-5e31-48e5-8a70-7c6bad9afe91 => generated 1267 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:47:09.794677 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-c2e3ed6d-2887-4df1-92db-6d09e9f79112 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:47:09.795341 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-c2e3ed6d-2887-4df1-92db-6d09e9f79112 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e038fb54-192d-4af5-a273-955b1493d4b4] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:47:09.802539 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-c2e3ed6d-2887-4df1-92db-6d09e9f79112 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:09.802998 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-c2e3ed6d-2887-4df1-92db-6d09e9f79112 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:09.803789 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-c2e3ed6d-2887-4df1-92db-6d09e9f79112 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:09.804233 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-c2e3ed6d-2887-4df1-92db-6d09e9f79112 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:09.952285 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-c2e3ed6d-2887-4df1-92db-6d09e9f79112 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb4b0cf5f8b4274b787f327793964f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ba26b86c7243dab8e6c6b84ed674e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:47:09.955788 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG dbcounter [-] [118158] Writing DB stats nova_cell1:SELECT=100 {{(pid=118158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:47:09.960356 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-c2e3ed6d-2887-4df1-92db-6d09e9f79112 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e038fb54-192d-4af5-a273-955b1493d4b4" status: 200 len: 1364 microversion: 2.1 time: 0.170441 Jun 07 14:47:09.960939 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 398/787] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:47:09 2022] GET /compute/v2.1/servers/e038fb54-192d-4af5-a273-955b1493d4b4 => generated 1364 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:47:10.351206 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-2aeb419c-59d3-4f63-90bc-1220cc4330d6 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:47:10.351931 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-2aeb419c-59d3-4f63-90bc-1220cc4330d6 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: c7578860-5e31-48e5-8a70-7c6bad9afe91] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:47:10.358806 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-2aeb419c-59d3-4f63-90bc-1220cc4330d6 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:10.359326 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-2aeb419c-59d3-4f63-90bc-1220cc4330d6 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:10.360090 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-2aeb419c-59d3-4f63-90bc-1220cc4330d6 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:10.360560 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-2aeb419c-59d3-4f63-90bc-1220cc4330d6 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:10.493603 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-2aeb419c-59d3-4f63-90bc-1220cc4330d6 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15f5fa82414bdf8ca3f6723c0a8d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e877695d0f46339cb4b9b86aac3662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:47:10.501154 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-2aeb419c-59d3-4f63-90bc-1220cc4330d6 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "GET /compute/v2.1/servers/c7578860-5e31-48e5-8a70-7c6bad9afe91" status: 200 len: 1267 microversion: 2.1 time: 0.154581 Jun 07 14:47:10.501694 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 390/788] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:47:10 2022] GET /compute/v2.1/servers/c7578860-5e31-48e5-8a70-7c6bad9afe91 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:47:10.978352 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-94641529-4ee0-4e68-b6b3-8100b13f87d9 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:47:10.979180 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-94641529-4ee0-4e68-b6b3-8100b13f87d9 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e038fb54-192d-4af5-a273-955b1493d4b4] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:47:10.985508 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-94641529-4ee0-4e68-b6b3-8100b13f87d9 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:10.985950 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-94641529-4ee0-4e68-b6b3-8100b13f87d9 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:10.986711 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-94641529-4ee0-4e68-b6b3-8100b13f87d9 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:10.987141 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-94641529-4ee0-4e68-b6b3-8100b13f87d9 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:11.122485 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-94641529-4ee0-4e68-b6b3-8100b13f87d9 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb4b0cf5f8b4274b787f327793964f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ba26b86c7243dab8e6c6b84ed674e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:47:11.129907 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-94641529-4ee0-4e68-b6b3-8100b13f87d9 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e038fb54-192d-4af5-a273-955b1493d4b4" status: 200 len: 1364 microversion: 2.1 time: 0.155800 Jun 07 14:47:11.130823 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 399/789] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:47:10 2022] GET /compute/v2.1/servers/e038fb54-192d-4af5-a273-955b1493d4b4 => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:47:11.518400 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-4c0fdf87-43e5-4569-a4a4-581eb96e7d3b tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:47:11.519658 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-4c0fdf87-43e5-4569-a4a4-581eb96e7d3b tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: c7578860-5e31-48e5-8a70-7c6bad9afe91] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:47:11.526530 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-4c0fdf87-43e5-4569-a4a4-581eb96e7d3b tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:11.526982 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-4c0fdf87-43e5-4569-a4a4-581eb96e7d3b tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:11.527770 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-4c0fdf87-43e5-4569-a4a4-581eb96e7d3b tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:11.528204 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-4c0fdf87-43e5-4569-a4a4-581eb96e7d3b tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:11.668781 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-4c0fdf87-43e5-4569-a4a4-581eb96e7d3b tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15f5fa82414bdf8ca3f6723c0a8d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e877695d0f46339cb4b9b86aac3662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:47:11.677327 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-4c0fdf87-43e5-4569-a4a4-581eb96e7d3b tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "GET /compute/v2.1/servers/c7578860-5e31-48e5-8a70-7c6bad9afe91" status: 200 len: 1267 microversion: 2.1 time: 0.162658 Jun 07 14:47:11.677886 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 391/790] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:47:11 2022] GET /compute/v2.1/servers/c7578860-5e31-48e5-8a70-7c6bad9afe91 => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:47:12.146506 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-b2ea5bd4-9747-439d-b626-715676996362 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:47:12.148469 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-b2ea5bd4-9747-439d-b626-715676996362 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e038fb54-192d-4af5-a273-955b1493d4b4] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:47:12.155215 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-b2ea5bd4-9747-439d-b626-715676996362 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:12.155666 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-b2ea5bd4-9747-439d-b626-715676996362 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:12.156497 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-b2ea5bd4-9747-439d-b626-715676996362 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:12.156932 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-b2ea5bd4-9747-439d-b626-715676996362 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:12.290901 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-b2ea5bd4-9747-439d-b626-715676996362 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb4b0cf5f8b4274b787f327793964f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ba26b86c7243dab8e6c6b84ed674e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:47:12.298419 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-b2ea5bd4-9747-439d-b626-715676996362 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e038fb54-192d-4af5-a273-955b1493d4b4" status: 200 len: 1364 microversion: 2.1 time: 0.155763 Jun 07 14:47:12.299021 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 400/791] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:47:12 2022] GET /compute/v2.1/servers/e038fb54-192d-4af5-a273-955b1493d4b4 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:47:12.693844 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-a862cf89-050b-4e57-a338-101464b64904 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:47:12.694451 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-a862cf89-050b-4e57-a338-101464b64904 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: c7578860-5e31-48e5-8a70-7c6bad9afe91] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:47:12.700904 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-a862cf89-050b-4e57-a338-101464b64904 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:12.701345 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-a862cf89-050b-4e57-a338-101464b64904 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:12.702099 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-a862cf89-050b-4e57-a338-101464b64904 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:12.702527 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-a862cf89-050b-4e57-a338-101464b64904 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:12.844530 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-a862cf89-050b-4e57-a338-101464b64904 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15f5fa82414bdf8ca3f6723c0a8d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e877695d0f46339cb4b9b86aac3662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:47:12.852115 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-a862cf89-050b-4e57-a338-101464b64904 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "GET /compute/v2.1/servers/c7578860-5e31-48e5-8a70-7c6bad9afe91" status: 200 len: 1267 microversion: 2.1 time: 0.162029 Jun 07 14:47:12.852705 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 392/792] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:47:12 2022] GET /compute/v2.1/servers/c7578860-5e31-48e5-8a70-7c6bad9afe91 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:47:13.315459 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-dced07c1-480e-4a70-ad02-c090c137211b tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:47:13.316628 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-dced07c1-480e-4a70-ad02-c090c137211b tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e038fb54-192d-4af5-a273-955b1493d4b4] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:47:13.322934 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-dced07c1-480e-4a70-ad02-c090c137211b tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:13.323391 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-dced07c1-480e-4a70-ad02-c090c137211b tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:13.324157 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-dced07c1-480e-4a70-ad02-c090c137211b tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:13.324623 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-dced07c1-480e-4a70-ad02-c090c137211b tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:13.582124 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG dbcounter [-] [118158] Writing DB stats nova_cell0:SELECT=2 {{(pid=118158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:47:13.611887 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-dced07c1-480e-4a70-ad02-c090c137211b tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb4b0cf5f8b4274b787f327793964f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ba26b86c7243dab8e6c6b84ed674e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:47:13.620034 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-dced07c1-480e-4a70-ad02-c090c137211b tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e038fb54-192d-4af5-a273-955b1493d4b4" status: 200 len: 1364 microversion: 2.1 time: 0.308694 Jun 07 14:47:13.621450 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 401/793] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:47:13 2022] GET /compute/v2.1/servers/e038fb54-192d-4af5-a273-955b1493d4b4 => generated 1364 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:47:13.870549 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-78587f8a-c015-4fca-8add-1e18cd511c46 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:47:13.872180 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-78587f8a-c015-4fca-8add-1e18cd511c46 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: c7578860-5e31-48e5-8a70-7c6bad9afe91] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:47:13.874658 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG dbcounter [-] [118157] Writing DB stats nova_cell0:SELECT=2 {{(pid=118157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:47:13.875801 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG dbcounter [-] [118157] Writing DB stats nova_cell0:SELECT=10 {{(pid=118157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:47:13.883051 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-78587f8a-c015-4fca-8add-1e18cd511c46 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:13.883727 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-78587f8a-c015-4fca-8add-1e18cd511c46 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:13.885505 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-78587f8a-c015-4fca-8add-1e18cd511c46 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:13.886108 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-78587f8a-c015-4fca-8add-1e18cd511c46 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:14.033348 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-78587f8a-c015-4fca-8add-1e18cd511c46 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15f5fa82414bdf8ca3f6723c0a8d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e877695d0f46339cb4b9b86aac3662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:47:14.040848 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-78587f8a-c015-4fca-8add-1e18cd511c46 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "GET /compute/v2.1/servers/c7578860-5e31-48e5-8a70-7c6bad9afe91" status: 200 len: 1267 microversion: 2.1 time: 0.174919 Jun 07 14:47:14.041391 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 393/794] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:47:13 2022] GET /compute/v2.1/servers/c7578860-5e31-48e5-8a70-7c6bad9afe91 => generated 1267 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:47:14.637981 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-f5b92631-9f3c-4546-9493-c84d10419a42 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:47:14.638606 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-f5b92631-9f3c-4546-9493-c84d10419a42 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e038fb54-192d-4af5-a273-955b1493d4b4] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:47:14.640728 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG dbcounter [-] [118158] Writing DB stats nova_cell0:SELECT=10 {{(pid=118158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:47:14.647234 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-f5b92631-9f3c-4546-9493-c84d10419a42 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:14.647703 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-f5b92631-9f3c-4546-9493-c84d10419a42 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:14.648504 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-f5b92631-9f3c-4546-9493-c84d10419a42 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:14.648970 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-f5b92631-9f3c-4546-9493-c84d10419a42 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:14.781064 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-f5b92631-9f3c-4546-9493-c84d10419a42 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb4b0cf5f8b4274b787f327793964f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ba26b86c7243dab8e6c6b84ed674e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:47:14.788774 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-f5b92631-9f3c-4546-9493-c84d10419a42 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e038fb54-192d-4af5-a273-955b1493d4b4" status: 200 len: 1364 microversion: 2.1 time: 0.154613 Jun 07 14:47:14.789330 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 402/795] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:47:14 2022] GET /compute/v2.1/servers/e038fb54-192d-4af5-a273-955b1493d4b4 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:47:15.058181 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-499a260e-7bd5-43f4-81db-443ac01e7d9e tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:47:15.058845 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-499a260e-7bd5-43f4-81db-443ac01e7d9e tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: c7578860-5e31-48e5-8a70-7c6bad9afe91] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:47:15.066227 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-499a260e-7bd5-43f4-81db-443ac01e7d9e tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:15.066676 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-499a260e-7bd5-43f4-81db-443ac01e7d9e tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:15.067440 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-499a260e-7bd5-43f4-81db-443ac01e7d9e tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:15.067873 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-499a260e-7bd5-43f4-81db-443ac01e7d9e tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:15.197041 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-499a260e-7bd5-43f4-81db-443ac01e7d9e tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15f5fa82414bdf8ca3f6723c0a8d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e877695d0f46339cb4b9b86aac3662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:47:15.204363 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-499a260e-7bd5-43f4-81db-443ac01e7d9e tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "GET /compute/v2.1/servers/c7578860-5e31-48e5-8a70-7c6bad9afe91" status: 200 len: 1267 microversion: 2.1 time: 0.150057 Jun 07 14:47:15.204955 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 394/796] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:47:15 2022] GET /compute/v2.1/servers/c7578860-5e31-48e5-8a70-7c6bad9afe91 => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:47:15.807642 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-5ac2ced9-dcfc-4b3c-8d74-f1ee2996900a tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:47:15.808310 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-5ac2ced9-dcfc-4b3c-8d74-f1ee2996900a tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e038fb54-192d-4af5-a273-955b1493d4b4] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:47:15.815154 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5ac2ced9-dcfc-4b3c-8d74-f1ee2996900a tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:15.815608 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5ac2ced9-dcfc-4b3c-8d74-f1ee2996900a tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:15.816390 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5ac2ced9-dcfc-4b3c-8d74-f1ee2996900a tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:15.816842 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5ac2ced9-dcfc-4b3c-8d74-f1ee2996900a tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:15.951549 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-5ac2ced9-dcfc-4b3c-8d74-f1ee2996900a tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb4b0cf5f8b4274b787f327793964f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ba26b86c7243dab8e6c6b84ed674e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:47:15.959203 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-5ac2ced9-dcfc-4b3c-8d74-f1ee2996900a tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e038fb54-192d-4af5-a273-955b1493d4b4" status: 200 len: 1364 microversion: 2.1 time: 0.155802 Jun 07 14:47:15.960402 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 403/797] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:47:15 2022] GET /compute/v2.1/servers/e038fb54-192d-4af5-a273-955b1493d4b4 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:47:16.060817 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [req-98e26bf6-ccbf-4255-b6e4-6956d4260216 req-454aaf64-85c9-4675-8dd2-cefb4d3beea2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e038fb54-192d-4af5-a273-955b1493d4b4", "name": "network-vif-plugged", "status": "completed", "tag": "00a49620-6acb-4d1d-8c32-f724d94ef876"}]} {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:47:16.069997 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [req-98e26bf6-ccbf-4255-b6e4-6956d4260216 req-454aaf64-85c9-4675-8dd2-cefb4d3beea2 service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:16.070612 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [req-98e26bf6-ccbf-4255-b6e4-6956d4260216 req-454aaf64-85c9-4675-8dd2-cefb4d3beea2 service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:16.085919 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.compute.server_external_events [req-98e26bf6-ccbf-4255-b6e4-6956d4260216 req-454aaf64-85c9-4675-8dd2-cefb4d3beea2 service nova] Creating event network-vif-plugged:00a49620-6acb-4d1d-8c32-f724d94ef876 for instance e038fb54-192d-4af5-a273-955b1493d4b4 on hv-cinder-84497 Jun 07 14:47:16.091539 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [req-98e26bf6-ccbf-4255-b6e4-6956d4260216 req-454aaf64-85c9-4675-8dd2-cefb4d3beea2 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034288 Jun 07 14:47:16.092459 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 395/798] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jun 7 14:47:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:47:16.223355 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-598f2740-766c-4902-a713-5872dc668a98 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:47:16.224011 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-598f2740-766c-4902-a713-5872dc668a98 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: c7578860-5e31-48e5-8a70-7c6bad9afe91] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:47:16.230468 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-598f2740-766c-4902-a713-5872dc668a98 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:16.234649 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-598f2740-766c-4902-a713-5872dc668a98 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:16.234649 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-598f2740-766c-4902-a713-5872dc668a98 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:16.234649 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-598f2740-766c-4902-a713-5872dc668a98 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:16.369136 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-598f2740-766c-4902-a713-5872dc668a98 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15f5fa82414bdf8ca3f6723c0a8d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e877695d0f46339cb4b9b86aac3662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:47:16.378023 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-598f2740-766c-4902-a713-5872dc668a98 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "GET /compute/v2.1/servers/c7578860-5e31-48e5-8a70-7c6bad9afe91" status: 200 len: 1267 microversion: 2.1 time: 0.158795 Jun 07 14:47:16.378999 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 404/799] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:47:16 2022] GET /compute/v2.1/servers/c7578860-5e31-48e5-8a70-7c6bad9afe91 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:47:16.976863 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-434f10b8-d7ff-42ce-b05d-74a334e334cc tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:47:16.977554 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-434f10b8-d7ff-42ce-b05d-74a334e334cc tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e038fb54-192d-4af5-a273-955b1493d4b4] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:47:16.983755 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-434f10b8-d7ff-42ce-b05d-74a334e334cc tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:16.984197 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-434f10b8-d7ff-42ce-b05d-74a334e334cc tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:16.984981 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-434f10b8-d7ff-42ce-b05d-74a334e334cc tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:16.985416 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-434f10b8-d7ff-42ce-b05d-74a334e334cc tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:17.123808 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-434f10b8-d7ff-42ce-b05d-74a334e334cc tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb4b0cf5f8b4274b787f327793964f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ba26b86c7243dab8e6c6b84ed674e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:47:17.128072 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG dbcounter [-] [118157] Writing DB stats nova_cell1:SELECT=100 {{(pid=118157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:47:17.133039 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-434f10b8-d7ff-42ce-b05d-74a334e334cc tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e038fb54-192d-4af5-a273-955b1493d4b4" status: 200 len: 1364 microversion: 2.1 time: 0.160449 Jun 07 14:47:17.139055 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 396/800] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:47:16 2022] GET /compute/v2.1/servers/e038fb54-192d-4af5-a273-955b1493d4b4 => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:47:17.393932 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-27d50294-e8ed-4b5c-a4ee-cd4eab551a5b tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:47:17.394575 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-27d50294-e8ed-4b5c-a4ee-cd4eab551a5b tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: c7578860-5e31-48e5-8a70-7c6bad9afe91] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:47:17.401042 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-27d50294-e8ed-4b5c-a4ee-cd4eab551a5b tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:17.401495 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-27d50294-e8ed-4b5c-a4ee-cd4eab551a5b tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:17.402265 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-27d50294-e8ed-4b5c-a4ee-cd4eab551a5b tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:17.402702 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-27d50294-e8ed-4b5c-a4ee-cd4eab551a5b tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:17.533832 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-27d50294-e8ed-4b5c-a4ee-cd4eab551a5b tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15f5fa82414bdf8ca3f6723c0a8d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e877695d0f46339cb4b9b86aac3662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:47:17.541474 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-27d50294-e8ed-4b5c-a4ee-cd4eab551a5b tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "GET /compute/v2.1/servers/c7578860-5e31-48e5-8a70-7c6bad9afe91" status: 200 len: 1267 microversion: 2.1 time: 0.151323 Jun 07 14:47:17.542199 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 405/801] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:47:17 2022] GET /compute/v2.1/servers/c7578860-5e31-48e5-8a70-7c6bad9afe91 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:47:18.151445 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-1bb52e5f-4029-4312-8294-3f9f65c07313 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:47:18.152062 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-1bb52e5f-4029-4312-8294-3f9f65c07313 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e038fb54-192d-4af5-a273-955b1493d4b4] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:47:18.158698 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-1bb52e5f-4029-4312-8294-3f9f65c07313 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:18.159142 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-1bb52e5f-4029-4312-8294-3f9f65c07313 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:18.159953 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-1bb52e5f-4029-4312-8294-3f9f65c07313 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:18.160407 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-1bb52e5f-4029-4312-8294-3f9f65c07313 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:18.344833 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-1bb52e5f-4029-4312-8294-3f9f65c07313 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb4b0cf5f8b4274b787f327793964f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ba26b86c7243dab8e6c6b84ed674e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:47:18.352274 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-1bb52e5f-4029-4312-8294-3f9f65c07313 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e038fb54-192d-4af5-a273-955b1493d4b4" status: 200 len: 1550 microversion: 2.1 time: 0.205475 Jun 07 14:47:18.352874 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 397/802] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:47:18 2022] GET /compute/v2.1/servers/e038fb54-192d-4af5-a273-955b1493d4b4 => generated 1550 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:47:18.376798 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-43aa11da-98b0-4cbd-a062-96b4a8dc0a85 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:47:18.376798 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-43aa11da-98b0-4cbd-a062-96b4a8dc0a85 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e038fb54-192d-4af5-a273-955b1493d4b4] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:47:18.381076 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-43aa11da-98b0-4cbd-a062-96b4a8dc0a85 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:18.381531 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-43aa11da-98b0-4cbd-a062-96b4a8dc0a85 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:18.382301 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-43aa11da-98b0-4cbd-a062-96b4a8dc0a85 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:18.382765 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-43aa11da-98b0-4cbd-a062-96b4a8dc0a85 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:18.462771 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-43aa11da-98b0-4cbd-a062-96b4a8dc0a85 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e038fb54-192d-4af5-a273-955b1493d4b4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093133 Jun 07 14:47:18.463394 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 406/803] 10.222.0.85 () {58 vars in 1274 bytes} [Tue Jun 7 14:47:18 2022] GET /compute/v2.1/servers/e038fb54-192d-4af5-a273-955b1493d4b4/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 14:47:18.566997 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-2f678d78-a573-4ebb-b510-88e569933e15 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:47:18.568063 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-2f678d78-a573-4ebb-b510-88e569933e15 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: c7578860-5e31-48e5-8a70-7c6bad9afe91] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:47:18.574980 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-2f678d78-a573-4ebb-b510-88e569933e15 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:18.575437 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-2f678d78-a573-4ebb-b510-88e569933e15 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:18.580803 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-2f678d78-a573-4ebb-b510-88e569933e15 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:18.580803 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-2f678d78-a573-4ebb-b510-88e569933e15 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:18.721609 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-2f678d78-a573-4ebb-b510-88e569933e15 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15f5fa82414bdf8ca3f6723c0a8d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e877695d0f46339cb4b9b86aac3662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:47:18.730333 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-2f678d78-a573-4ebb-b510-88e569933e15 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "GET /compute/v2.1/servers/c7578860-5e31-48e5-8a70-7c6bad9afe91" status: 200 len: 1267 microversion: 2.1 time: 0.175231 Jun 07 14:47:18.732328 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 398/804] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:47:18 2022] GET /compute/v2.1/servers/c7578860-5e31-48e5-8a70-7c6bad9afe91 => generated 1267 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:47:19.536977 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [req-dd80f09f-a510-4cbd-9944-89c8bfde8040 req-a7f8100b-7495-4fc3-8bb5-0608751dea81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e038fb54-192d-4af5-a273-955b1493d4b4", "tag": "00a49620-6acb-4d1d-8c32-f724d94ef876"}]} {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:47:19.546077 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [req-dd80f09f-a510-4cbd-9944-89c8bfde8040 req-a7f8100b-7495-4fc3-8bb5-0608751dea81 service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:19.546602 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [req-dd80f09f-a510-4cbd-9944-89c8bfde8040 req-a7f8100b-7495-4fc3-8bb5-0608751dea81 service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:19.558557 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.compute.server_external_events [req-dd80f09f-a510-4cbd-9944-89c8bfde8040 req-a7f8100b-7495-4fc3-8bb5-0608751dea81 service nova] Creating event network-changed:00a49620-6acb-4d1d-8c32-f724d94ef876 for instance e038fb54-192d-4af5-a273-955b1493d4b4 on hv-cinder-84497 Jun 07 14:47:19.563849 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [req-dd80f09f-a510-4cbd-9944-89c8bfde8040 req-a7f8100b-7495-4fc3-8bb5-0608751dea81 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030981 Jun 07 14:47:19.564585 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 407/805] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jun 7 14:47:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:47:19.754566 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-157f6011-cf86-422b-9ea3-6ff5ad0be709 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:47:19.755232 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-157f6011-cf86-422b-9ea3-6ff5ad0be709 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: c7578860-5e31-48e5-8a70-7c6bad9afe91] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:47:19.766364 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-157f6011-cf86-422b-9ea3-6ff5ad0be709 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:19.766821 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-157f6011-cf86-422b-9ea3-6ff5ad0be709 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:19.767761 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-157f6011-cf86-422b-9ea3-6ff5ad0be709 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:19.768214 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-157f6011-cf86-422b-9ea3-6ff5ad0be709 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:19.989470 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-157f6011-cf86-422b-9ea3-6ff5ad0be709 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15f5fa82414bdf8ca3f6723c0a8d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e877695d0f46339cb4b9b86aac3662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:47:19.999043 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-157f6011-cf86-422b-9ea3-6ff5ad0be709 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "GET /compute/v2.1/servers/c7578860-5e31-48e5-8a70-7c6bad9afe91" status: 200 len: 1267 microversion: 2.1 time: 0.255371 Jun 07 14:47:20.005059 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 399/806] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:47:19 2022] GET /compute/v2.1/servers/c7578860-5e31-48e5-8a70-7c6bad9afe91 => generated 1267 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:47:21.020877 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-25274c57-d637-41c1-a3c8-e4df055518ce tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:47:21.021721 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-25274c57-d637-41c1-a3c8-e4df055518ce tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: c7578860-5e31-48e5-8a70-7c6bad9afe91] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:47:21.028219 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-25274c57-d637-41c1-a3c8-e4df055518ce tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:21.028730 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-25274c57-d637-41c1-a3c8-e4df055518ce tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:21.029508 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-25274c57-d637-41c1-a3c8-e4df055518ce tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:21.029955 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-25274c57-d637-41c1-a3c8-e4df055518ce tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:21.165553 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-25274c57-d637-41c1-a3c8-e4df055518ce tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15f5fa82414bdf8ca3f6723c0a8d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e877695d0f46339cb4b9b86aac3662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:47:21.177484 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-25274c57-d637-41c1-a3c8-e4df055518ce tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "GET /compute/v2.1/servers/c7578860-5e31-48e5-8a70-7c6bad9afe91" status: 200 len: 1267 microversion: 2.1 time: 0.161545 Jun 07 14:47:21.178038 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 408/807] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:47:21 2022] GET /compute/v2.1/servers/c7578860-5e31-48e5-8a70-7c6bad9afe91 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:47:22.195214 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-c93e2218-e98d-48b4-a04e-b87517a40286 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:47:22.196562 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-c93e2218-e98d-48b4-a04e-b87517a40286 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: c7578860-5e31-48e5-8a70-7c6bad9afe91] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:47:22.204282 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-c93e2218-e98d-48b4-a04e-b87517a40286 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:22.205038 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-c93e2218-e98d-48b4-a04e-b87517a40286 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:22.205814 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-c93e2218-e98d-48b4-a04e-b87517a40286 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:22.206413 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-c93e2218-e98d-48b4-a04e-b87517a40286 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:22.344715 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-c93e2218-e98d-48b4-a04e-b87517a40286 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15f5fa82414bdf8ca3f6723c0a8d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e877695d0f46339cb4b9b86aac3662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:47:22.353108 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-c93e2218-e98d-48b4-a04e-b87517a40286 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "GET /compute/v2.1/servers/c7578860-5e31-48e5-8a70-7c6bad9afe91" status: 200 len: 1267 microversion: 2.1 time: 0.162796 Jun 07 14:47:22.353970 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 400/808] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:47:22 2022] GET /compute/v2.1/servers/c7578860-5e31-48e5-8a70-7c6bad9afe91 => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:47:23.370543 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-b23bcf3c-8246-4ed2-a6a9-d56631843bc6 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:47:23.371159 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-b23bcf3c-8246-4ed2-a6a9-d56631843bc6 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: c7578860-5e31-48e5-8a70-7c6bad9afe91] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:47:23.373710 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG dbcounter [-] [118158] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=3 {{(pid=118158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:47:23.381402 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-b23bcf3c-8246-4ed2-a6a9-d56631843bc6 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:23.381402 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-b23bcf3c-8246-4ed2-a6a9-d56631843bc6 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:23.381402 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-b23bcf3c-8246-4ed2-a6a9-d56631843bc6 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:23.381402 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-b23bcf3c-8246-4ed2-a6a9-d56631843bc6 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:23.510754 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-b23bcf3c-8246-4ed2-a6a9-d56631843bc6 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15f5fa82414bdf8ca3f6723c0a8d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e877695d0f46339cb4b9b86aac3662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:47:23.518595 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-b23bcf3c-8246-4ed2-a6a9-d56631843bc6 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "GET /compute/v2.1/servers/c7578860-5e31-48e5-8a70-7c6bad9afe91" status: 200 len: 1267 microversion: 2.1 time: 0.151856 Jun 07 14:47:23.519127 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 409/809] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:47:23 2022] GET /compute/v2.1/servers/c7578860-5e31-48e5-8a70-7c6bad9afe91 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:47:24.141787 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [req-28669b15-456a-49c4-aa44-43384a1497f7 req-941d60d2-5147-445f-8fcc-81544b3f2395 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7578860-5e31-48e5-8a70-7c6bad9afe91", "name": "network-vif-plugged", "status": "completed", "tag": "a31fb889-4abe-498c-aa99-a0264a6ccf0a"}]} {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:47:24.150988 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [req-28669b15-456a-49c4-aa44-43384a1497f7 req-941d60d2-5147-445f-8fcc-81544b3f2395 service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:24.151435 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [req-28669b15-456a-49c4-aa44-43384a1497f7 req-941d60d2-5147-445f-8fcc-81544b3f2395 service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:24.163638 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.compute.server_external_events [req-28669b15-456a-49c4-aa44-43384a1497f7 req-941d60d2-5147-445f-8fcc-81544b3f2395 service nova] Creating event network-vif-plugged:a31fb889-4abe-498c-aa99-a0264a6ccf0a for instance c7578860-5e31-48e5-8a70-7c6bad9afe91 on hv-cinder-84497 Jun 07 14:47:24.168786 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [req-28669b15-456a-49c4-aa44-43384a1497f7 req-941d60d2-5147-445f-8fcc-81544b3f2395 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030771 Jun 07 14:47:24.169612 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 401/810] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jun 7 14:47:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:47:24.535739 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-44af41e7-8a2d-4cce-93ba-450c31a5569f tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:47:24.536435 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-44af41e7-8a2d-4cce-93ba-450c31a5569f tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: c7578860-5e31-48e5-8a70-7c6bad9afe91] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:47:24.543784 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-44af41e7-8a2d-4cce-93ba-450c31a5569f tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:24.544237 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-44af41e7-8a2d-4cce-93ba-450c31a5569f tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:24.545049 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-44af41e7-8a2d-4cce-93ba-450c31a5569f tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:24.545558 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-44af41e7-8a2d-4cce-93ba-450c31a5569f tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:24.736882 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-44af41e7-8a2d-4cce-93ba-450c31a5569f tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15f5fa82414bdf8ca3f6723c0a8d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e877695d0f46339cb4b9b86aac3662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:47:24.744392 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-44af41e7-8a2d-4cce-93ba-450c31a5569f tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "GET /compute/v2.1/servers/c7578860-5e31-48e5-8a70-7c6bad9afe91" status: 200 len: 1267 microversion: 2.1 time: 0.213278 Jun 07 14:47:24.745039 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 410/811] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:47:24 2022] GET /compute/v2.1/servers/c7578860-5e31-48e5-8a70-7c6bad9afe91 => generated 1267 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:47:25.764152 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-c06d04f6-58c4-453c-a85e-77d5d1404762 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:47:25.765044 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-c06d04f6-58c4-453c-a85e-77d5d1404762 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: c7578860-5e31-48e5-8a70-7c6bad9afe91] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:47:25.772142 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-c06d04f6-58c4-453c-a85e-77d5d1404762 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:25.772880 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-c06d04f6-58c4-453c-a85e-77d5d1404762 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:25.773685 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-c06d04f6-58c4-453c-a85e-77d5d1404762 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:25.774116 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-c06d04f6-58c4-453c-a85e-77d5d1404762 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:25.911393 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-c06d04f6-58c4-453c-a85e-77d5d1404762 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15f5fa82414bdf8ca3f6723c0a8d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e877695d0f46339cb4b9b86aac3662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:47:25.918907 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-c06d04f6-58c4-453c-a85e-77d5d1404762 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "GET /compute/v2.1/servers/c7578860-5e31-48e5-8a70-7c6bad9afe91" status: 200 len: 1267 microversion: 2.1 time: 0.159148 Jun 07 14:47:25.919492 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 402/812] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:47:25 2022] GET /compute/v2.1/servers/c7578860-5e31-48e5-8a70-7c6bad9afe91 => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:47:26.935440 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-f59916d4-5041-4f76-88a3-e6ad0d46ffbc tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:47:26.936048 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-f59916d4-5041-4f76-88a3-e6ad0d46ffbc tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: c7578860-5e31-48e5-8a70-7c6bad9afe91] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:47:26.943433 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-f59916d4-5041-4f76-88a3-e6ad0d46ffbc tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:26.943889 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-f59916d4-5041-4f76-88a3-e6ad0d46ffbc tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:26.944709 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-f59916d4-5041-4f76-88a3-e6ad0d46ffbc tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:26.945155 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-f59916d4-5041-4f76-88a3-e6ad0d46ffbc tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:27.094669 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-f59916d4-5041-4f76-88a3-e6ad0d46ffbc tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15f5fa82414bdf8ca3f6723c0a8d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e877695d0f46339cb4b9b86aac3662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:47:27.102750 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-f59916d4-5041-4f76-88a3-e6ad0d46ffbc tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "GET /compute/v2.1/servers/c7578860-5e31-48e5-8a70-7c6bad9afe91" status: 200 len: 1454 microversion: 2.1 time: 0.171181 Jun 07 14:47:27.103304 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 411/813] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:47:26 2022] GET /compute/v2.1/servers/c7578860-5e31-48e5-8a70-7c6bad9afe91 => generated 1454 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:47:27.119525 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-132d46e5-77de-40d3-b310-268291c0e6e7 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:47:27.120273 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-132d46e5-77de-40d3-b310-268291c0e6e7 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: c7578860-5e31-48e5-8a70-7c6bad9afe91] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:47:27.127033 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-132d46e5-77de-40d3-b310-268291c0e6e7 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:27.127493 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-132d46e5-77de-40d3-b310-268291c0e6e7 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:27.128288 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-132d46e5-77de-40d3-b310-268291c0e6e7 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:27.128755 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-132d46e5-77de-40d3-b310-268291c0e6e7 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:27.265776 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-132d46e5-77de-40d3-b310-268291c0e6e7 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15f5fa82414bdf8ca3f6723c0a8d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e877695d0f46339cb4b9b86aac3662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:47:27.274146 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-132d46e5-77de-40d3-b310-268291c0e6e7 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "GET /compute/v2.1/servers/c7578860-5e31-48e5-8a70-7c6bad9afe91" status: 200 len: 1454 microversion: 2.1 time: 0.159125 Jun 07 14:47:27.278551 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 403/814] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:47:27 2022] GET /compute/v2.1/servers/c7578860-5e31-48e5-8a70-7c6bad9afe91 => generated 1454 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:47:29.555953 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [req-813927f1-b6f7-4427-8b25-64af3da24235 req-111aa5aa-72b6-49fe-8ee2-e2f07479c995 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7578860-5e31-48e5-8a70-7c6bad9afe91", "tag": "a31fb889-4abe-498c-aa99-a0264a6ccf0a"}]} {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:47:29.564646 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [req-813927f1-b6f7-4427-8b25-64af3da24235 req-111aa5aa-72b6-49fe-8ee2-e2f07479c995 service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:29.565090 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [req-813927f1-b6f7-4427-8b25-64af3da24235 req-111aa5aa-72b6-49fe-8ee2-e2f07479c995 service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:29.576248 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.compute.server_external_events [req-813927f1-b6f7-4427-8b25-64af3da24235 req-111aa5aa-72b6-49fe-8ee2-e2f07479c995 service nova] Creating event network-changed:a31fb889-4abe-498c-aa99-a0264a6ccf0a for instance c7578860-5e31-48e5-8a70-7c6bad9afe91 on hv-cinder-84497 Jun 07 14:47:29.581459 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [req-813927f1-b6f7-4427-8b25-64af3da24235 req-111aa5aa-72b6-49fe-8ee2-e2f07479c995 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029825 Jun 07 14:47:29.582036 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 412/815] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jun 7 14:47:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:47:37.459091 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-ac5aaa67-083f-47fc-9533-77ceb4faf876 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:47:37.459653 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-ac5aaa67-083f-47fc-9533-77ceb4faf876 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 3636f852-d3ce-4505-b21b-3bbfac40d180] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:47:37.462323 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG dbcounter [-] [118157] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=118157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:47:37.463247 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG dbcounter [-] [118157] Writing DB stats nova_cell1:SELECT=38 {{(pid=118157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:47:37.474130 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-ac5aaa67-083f-47fc-9533-77ceb4faf876 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:37.474130 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-ac5aaa67-083f-47fc-9533-77ceb4faf876 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:37.474130 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-ac5aaa67-083f-47fc-9533-77ceb4faf876 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:37.474130 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-ac5aaa67-083f-47fc-9533-77ceb4faf876 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:37.493630 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-ac5aaa67-083f-47fc-9533-77ceb4faf876 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/3636f852-d3ce-4505-b21b-3bbfac40d180/ips" status: 200 len: 149 microversion: 2.1 time: 0.038896 Jun 07 14:47:37.494196 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 404/816] 10.222.0.85 () {58 vars in 1247 bytes} [Tue Jun 7 14:47:37 2022] GET /compute/v2.1/servers/3636f852-d3ce-4505-b21b-3bbfac40d180/ips => generated 149 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 14:47:39.075338 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-df6d1aa1-ab55-4f6e-be8b-17c89dcd7e03 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1363ba3e-9f80-4f57-836e-01b9e0ef8152"}} {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:47:39.076551 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-df6d1aa1-ab55-4f6e-be8b-17c89dcd7e03 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 3636f852-d3ce-4505-b21b-3bbfac40d180] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:47:39.083023 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-df6d1aa1-ab55-4f6e-be8b-17c89dcd7e03 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:39.083478 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-df6d1aa1-ab55-4f6e-be8b-17c89dcd7e03 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:39.084833 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-df6d1aa1-ab55-4f6e-be8b-17c89dcd7e03 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:39.085283 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-df6d1aa1-ab55-4f6e-be8b-17c89dcd7e03 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:39.883079 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-df6d1aa1-ab55-4f6e-be8b-17c89dcd7e03 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "POST /compute/v2.1/servers/3636f852-d3ce-4505-b21b-3bbfac40d180/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.812685 Jun 07 14:47:39.883692 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 413/817] 10.222.0.85 () {60 vars in 1322 bytes} [Tue Jun 7 14:47:39 2022] POST /compute/v2.1/servers/3636f852-d3ce-4505-b21b-3bbfac40d180/os-volume_attachments => generated 194 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:47:48.468713 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-1dd3e4a1-a9b1-4f7e-9ad9-e4baac95b32d tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1363ba3e-9f80-4f57-836e-01b9e0ef8152"}} {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:47:48.469804 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-1dd3e4a1-a9b1-4f7e-9ad9-e4baac95b32d tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 3636f852-d3ce-4505-b21b-3bbfac40d180] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:47:48.477384 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-1dd3e4a1-a9b1-4f7e-9ad9-e4baac95b32d tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:48.477836 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-1dd3e4a1-a9b1-4f7e-9ad9-e4baac95b32d tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:48.478621 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-1dd3e4a1-a9b1-4f7e-9ad9-e4baac95b32d tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:48.479055 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-1dd3e4a1-a9b1-4f7e-9ad9-e4baac95b32d tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:48.562998 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.wsgi [None req-1dd3e4a1-a9b1-4f7e-9ad9-e4baac95b32d tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] HTTP exception thrown: Invalid volume: volume 1363ba3e-9f80-4f57-836e-01b9e0ef8152 is already attached to instances: 3636f852-d3ce-4505-b21b-3bbfac40d180 Jun 07 14:47:48.565016 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-1dd3e4a1-a9b1-4f7e-9ad9-e4baac95b32d tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Request method failure captured: Jun 07 14:47:48.565016 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: request: POST /compute/v2.1/servers/3636f852-d3ce-4505-b21b-3bbfac40d180/os-volume_attachments HTTP/1.1 Jun 07 14:47:48.565016 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Accept: application/json Jun 07 14:47:48.565016 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Accept-Encoding: identity Jun 07 14:47:48.565016 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Connection: close Jun 07 14:47:48.565016 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Content-Length: 74 Jun 07 14:47:48.565016 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Content-Type: application/json Jun 07 14:47:48.565016 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Host: 10.222.0.85 Jun 07 14:47:48.565016 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Openstack-System-Scope: None Jun 07 14:47:48.565016 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: User-Agent: python-urllib3/1.26.9 Jun 07 14:47:48.565016 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Auth-Token: gAAAAABin2MfTRQCz8-nJ9l6FZbbvZHr4ehXByNi3Z0iSJmei7E9Un8HbsXaII7Zrv5LEnKmQb4d93wyNQqjAkp1IKVfs3yISIEXnMvfKr46BwDX3CxPmlHLkbdOk4RqVmIQcl_yARDnVkQjkCk9boV0Z6LD9SMz4Q7cu_osT-ds_ddwKKWxW2w Jun 07 14:47:48.565016 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Domain-Id: None Jun 07 14:47:48.565016 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Domain-Name: None Jun 07 14:47:48.565016 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Identity-Status: Confirmed Jun 07 14:47:48.565016 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Is-Admin-Project: True Jun 07 14:47:48.565016 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Project-Domain-Id: default Jun 07 14:47:48.565016 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Project-Domain-Name: Default Jun 07 14:47:48.565016 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Project-Id: 8eae64ee53144e4f8d583bb4288c0aeb Jun 07 14:47:48.565016 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Project-Name: tempest-AttachVolumeNegativeTest-1508033184 Jun 07 14:47:48.565016 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Role: member,reader Jun 07 14:47:48.565016 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Roles: member,reader Jun 07 14:47:48.566842 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8eae64ee53144e4f8d583bb4288c0aeb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_8eae64ee53144e4f8d583bb4288c0aeb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8eae64ee53144e4f8d583bb4288c0aeb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/8eae64ee53144e4f8d583bb4288c0aeb"}]}] Jun 07 14:47:48.566842 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Tenant: tempest-AttachVolumeNegativeTest-1508033184 Jun 07 14:47:48.566842 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Tenant-Id: 8eae64ee53144e4f8d583bb4288c0aeb Jun 07 14:47:48.566842 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1508033184 Jun 07 14:47:48.566842 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User: tempest-AttachVolumeNegativeTest-1508033184-project Jun 07 14:47:48.566842 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User-Domain-Id: default Jun 07 14:47:48.566842 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User-Domain-Name: Default Jun 07 14:47:48.566842 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User-Id: 34eb9ec1f3ff44bbb03cf934cb2a04de Jun 07 14:47:48.566842 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User-Name: tempest-AttachVolumeNegativeTest-1508033184-project Jun 07 14:47:48.566842 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Jun 07 14:47:48.566842 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: {"volumeAttachment": {"volumeId": "1363ba3e-9f80-4f57-836e-01b9e0ef8152"}} Jun 07 14:47:48.566842 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: method: > Jun 07 14:47:48.567805 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: exception: Invalid volume: volume 1363ba3e-9f80-4f57-836e-01b9e0ef8152 is already attached to instances: 3636f852-d3ce-4505-b21b-3bbfac40d180 Jun 07 14:47:48.567805 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: action_args: {'server_id': '3636f852-d3ce-4505-b21b-3bbfac40d180', 'body': {'volumeAttachment': {'volumeId': '1363ba3e-9f80-4f57-836e-01b9e0ef8152'}}} Jun 07 14:47:48.567805 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:47:48.567805 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:47:48.567805 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 07 14:47:48.567805 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 07 14:47:48.567805 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 07 14:47:48.567805 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 07 14:47:48.567805 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 07 14:47:48.567805 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 07 14:47:48.567805 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 07 14:47:48.567805 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 07 14:47:48.567805 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 07 14:47:48.567805 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 07 14:47:48.567805 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 1363ba3e-9f80-4f57-836e-01b9e0ef8152 is already attached to instances: 3636f852-d3ce-4505-b21b-3bbfac40d180 Jun 07 14:47:48.567805 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:47:48.567805 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:47:48.567805 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:47:48.567805 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:47:48.569953 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:47:48.569953 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:47:48.569953 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:47:48.569953 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:47:48.569953 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:47:48.569953 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:47:48.569953 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 07 14:47:48.569953 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 14:47:48.569953 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 07 14:47:48.569953 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 14:47:48.569953 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 07 14:47:48.569953 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 14:47:48.569953 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 07 14:47:48.569953 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 07 14:47:48.569953 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 1363ba3e-9f80-4f57-836e-01b9e0ef8152 is already attached to instances: 3636f852-d3ce-4505-b21b-3bbfac40d180 Jun 07 14:47:48.569953 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:47:48.569953 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:47:48.569953 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:47:48.569953 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:47:48.569953 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:47:48.571499 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:47:48.571499 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:47:48.571499 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:47:48.571499 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 1363ba3e-9f80-4f57-836e-01b9e0ef8152 is already attached to instances: 3636f852-d3ce-4505-b21b-3bbfac40d180 Jun 07 14:47:48.571499 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:47:48.571499 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-1dd3e4a1-a9b1-4f7e-9ad9-e4baac95b32d tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Returning 400 to user: Invalid volume: volume 1363ba3e-9f80-4f57-836e-01b9e0ef8152 is already attached to instances: 3636f852-d3ce-4505-b21b-3bbfac40d180 {{(pid=118157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:47:48.571499 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-1dd3e4a1-a9b1-4f7e-9ad9-e4baac95b32d tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "POST /compute/v2.1/servers/3636f852-d3ce-4505-b21b-3bbfac40d180/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.101868 Jun 07 14:47:48.571499 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 405/818] 10.222.0.85 () {60 vars in 1322 bytes} [Tue Jun 7 14:47:48 2022] POST /compute/v2.1/servers/3636f852-d3ce-4505-b21b-3bbfac40d180/os-volume_attachments => generated 174 bytes in 103 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 07 14:47:48.633972 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-f6bc7c4b-00cd-4d1a-8c47-ffda3ebf343c tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:47:48.634548 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-f6bc7c4b-00cd-4d1a-8c47-ffda3ebf343c tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 3636f852-d3ce-4505-b21b-3bbfac40d180] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:47:48.641447 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-f6bc7c4b-00cd-4d1a-8c47-ffda3ebf343c tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:48.641896 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-f6bc7c4b-00cd-4d1a-8c47-ffda3ebf343c tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:48.642711 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-f6bc7c4b-00cd-4d1a-8c47-ffda3ebf343c tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:48.643089 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-f6bc7c4b-00cd-4d1a-8c47-ffda3ebf343c tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:48.646293 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG dbcounter [-] [118158] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:47:48.732644 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.objects.instance [None req-f6bc7c4b-00cd-4d1a-8c47-ffda3ebf343c tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lazy-loading 'services' on Instance uuid 3636f852-d3ce-4505-b21b-3bbfac40d180 {{(pid=118158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 14:47:49.008715 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-f6bc7c4b-00cd-4d1a-8c47-ffda3ebf343c tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "DELETE /compute/v2.1/servers/3636f852-d3ce-4505-b21b-3bbfac40d180/os-volume_attachments/1363ba3e-9f80-4f57-836e-01b9e0ef8152" status: 202 len: 0 microversion: 2.1 time: 0.379367 Jun 07 14:47:49.009302 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 414/819] 10.222.0.85 () {58 vars in 1415 bytes} [Tue Jun 7 14:47:48 2022] DELETE /compute/v2.1/servers/3636f852-d3ce-4505-b21b-3bbfac40d180/os-volume_attachments/1363ba3e-9f80-4f57-836e-01b9e0ef8152 => generated 0 bytes in 381 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 14:47:49.018080 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-6f69b1c0-f7b3-454e-8192-281b06551787 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:47:49.019417 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-6f69b1c0-f7b3-454e-8192-281b06551787 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 3636f852-d3ce-4505-b21b-3bbfac40d180] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:47:49.026712 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-6f69b1c0-f7b3-454e-8192-281b06551787 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:49.027173 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-6f69b1c0-f7b3-454e-8192-281b06551787 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:49.027959 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-6f69b1c0-f7b3-454e-8192-281b06551787 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:49.028422 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-6f69b1c0-f7b3-454e-8192-281b06551787 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:49.059125 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-6f69b1c0-f7b3-454e-8192-281b06551787 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/3636f852-d3ce-4505-b21b-3bbfac40d180/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045317 Jun 07 14:47:49.059676 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 406/820] 10.222.0.85 () {58 vars in 1301 bytes} [Tue Jun 7 14:47:49 2022] GET /compute/v2.1/servers/3636f852-d3ce-4505-b21b-3bbfac40d180/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 14:47:50.072079 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-5aea3a51-82cd-4687-bf94-f5b6cad37022 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:47:50.073261 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-5aea3a51-82cd-4687-bf94-f5b6cad37022 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 3636f852-d3ce-4505-b21b-3bbfac40d180] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:47:50.080221 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5aea3a51-82cd-4687-bf94-f5b6cad37022 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:50.080705 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5aea3a51-82cd-4687-bf94-f5b6cad37022 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:50.081583 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5aea3a51-82cd-4687-bf94-f5b6cad37022 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:50.082024 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5aea3a51-82cd-4687-bf94-f5b6cad37022 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:50.113208 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-5aea3a51-82cd-4687-bf94-f5b6cad37022 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/3636f852-d3ce-4505-b21b-3bbfac40d180/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046139 Jun 07 14:47:50.113777 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 415/821] 10.222.0.85 () {58 vars in 1301 bytes} [Tue Jun 7 14:47:50 2022] GET /compute/v2.1/servers/3636f852-d3ce-4505-b21b-3bbfac40d180/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:47:51.125709 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-6615d56f-b958-4394-accd-34ee6f3f984e tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:47:51.126808 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-6615d56f-b958-4394-accd-34ee6f3f984e tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 3636f852-d3ce-4505-b21b-3bbfac40d180] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:47:51.134090 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-6615d56f-b958-4394-accd-34ee6f3f984e tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:51.134570 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-6615d56f-b958-4394-accd-34ee6f3f984e tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:51.135319 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-6615d56f-b958-4394-accd-34ee6f3f984e tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:51.135753 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-6615d56f-b958-4394-accd-34ee6f3f984e tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:51.165592 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-6615d56f-b958-4394-accd-34ee6f3f984e tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/3636f852-d3ce-4505-b21b-3bbfac40d180/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043870 Jun 07 14:47:51.166182 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 407/822] 10.222.0.85 () {58 vars in 1301 bytes} [Tue Jun 7 14:47:51 2022] GET /compute/v2.1/servers/3636f852-d3ce-4505-b21b-3bbfac40d180/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 07 14:47:51.223293 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-0269f879-33b0-47a4-b2e9-cfcb2deb5ba8 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:47:51.223828 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-0269f879-33b0-47a4-b2e9-cfcb2deb5ba8 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 3636f852-d3ce-4505-b21b-3bbfac40d180] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:47:51.230245 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-0269f879-33b0-47a4-b2e9-cfcb2deb5ba8 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:51.230692 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-0269f879-33b0-47a4-b2e9-cfcb2deb5ba8 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:51.231452 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-0269f879-33b0-47a4-b2e9-cfcb2deb5ba8 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:51.231883 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-0269f879-33b0-47a4-b2e9-cfcb2deb5ba8 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:51.257638 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-0269f879-33b0-47a4-b2e9-cfcb2deb5ba8 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 3636f852-d3ce-4505-b21b-3bbfac40d180] Going to try to terminate instance {{(pid=118158) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 14:47:51.588269 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-0269f879-33b0-47a4-b2e9-cfcb2deb5ba8 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "DELETE /compute/v2.1/servers/3636f852-d3ce-4505-b21b-3bbfac40d180" status: 204 len: 0 microversion: 2.1 time: 0.368345 Jun 07 14:47:51.589192 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 416/823] 10.222.0.85 () {58 vars in 1238 bytes} [Tue Jun 7 14:47:51 2022] DELETE /compute/v2.1/servers/3636f852-d3ce-4505-b21b-3bbfac40d180 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 14:47:51.597243 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-9a0e15c7-8282-4601-9757-3fcb2ac1d6b3 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:47:51.597987 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-9a0e15c7-8282-4601-9757-3fcb2ac1d6b3 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 3636f852-d3ce-4505-b21b-3bbfac40d180] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:47:51.604484 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-9a0e15c7-8282-4601-9757-3fcb2ac1d6b3 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:51.604870 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-9a0e15c7-8282-4601-9757-3fcb2ac1d6b3 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:51.605636 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-9a0e15c7-8282-4601-9757-3fcb2ac1d6b3 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:51.606093 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-9a0e15c7-8282-4601-9757-3fcb2ac1d6b3 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:51.741686 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-9a0e15c7-8282-4601-9757-3fcb2ac1d6b3 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eb9ec1f3ff44bbb03cf934cb2a04de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eae64ee53144e4f8d583bb4288c0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:47:51.749997 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-9a0e15c7-8282-4601-9757-3fcb2ac1d6b3 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/3636f852-d3ce-4505-b21b-3bbfac40d180" status: 200 len: 1678 microversion: 2.1 time: 0.156518 Jun 07 14:47:51.750551 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 408/824] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:47:51 2022] GET /compute/v2.1/servers/3636f852-d3ce-4505-b21b-3bbfac40d180 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:47:52.766962 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-d62daeae-d832-4e16-8bfb-043378c1db39 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:47:52.769792 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-d62daeae-d832-4e16-8bfb-043378c1db39 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 3636f852-d3ce-4505-b21b-3bbfac40d180] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:47:52.775552 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-d62daeae-d832-4e16-8bfb-043378c1db39 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:52.775998 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-d62daeae-d832-4e16-8bfb-043378c1db39 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:52.776803 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-d62daeae-d832-4e16-8bfb-043378c1db39 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:52.777243 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-d62daeae-d832-4e16-8bfb-043378c1db39 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:52.909662 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-d62daeae-d832-4e16-8bfb-043378c1db39 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eb9ec1f3ff44bbb03cf934cb2a04de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eae64ee53144e4f8d583bb4288c0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:47:52.917091 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-d62daeae-d832-4e16-8bfb-043378c1db39 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/3636f852-d3ce-4505-b21b-3bbfac40d180" status: 200 len: 1678 microversion: 2.1 time: 0.154351 Jun 07 14:47:52.917676 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 417/825] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:47:52 2022] GET /compute/v2.1/servers/3636f852-d3ce-4505-b21b-3bbfac40d180 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:47:53.933828 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-3e1e636f-142a-4e57-9757-9b61ad75e1a9 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:47:53.934487 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-3e1e636f-142a-4e57-9757-9b61ad75e1a9 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 3636f852-d3ce-4505-b21b-3bbfac40d180] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:47:53.946454 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-3e1e636f-142a-4e57-9757-9b61ad75e1a9 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:53.946908 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-3e1e636f-142a-4e57-9757-9b61ad75e1a9 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:53.947687 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-3e1e636f-142a-4e57-9757-9b61ad75e1a9 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:53.948124 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-3e1e636f-142a-4e57-9757-9b61ad75e1a9 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:54.094185 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-3e1e636f-142a-4e57-9757-9b61ad75e1a9 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eb9ec1f3ff44bbb03cf934cb2a04de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eae64ee53144e4f8d583bb4288c0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:47:54.102099 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-3e1e636f-142a-4e57-9757-9b61ad75e1a9 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/3636f852-d3ce-4505-b21b-3bbfac40d180" status: 200 len: 1678 microversion: 2.1 time: 0.171978 Jun 07 14:47:54.102681 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 409/826] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:47:53 2022] GET /compute/v2.1/servers/3636f852-d3ce-4505-b21b-3bbfac40d180 => generated 1678 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:47:54.981815 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [req-4e2a1a83-b0bb-4333-96ff-c889689ce542 req-9a47944c-5edf-486b-bb62-c5aa40e98dd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3636f852-d3ce-4505-b21b-3bbfac40d180", "name": "network-vif-deleted", "tag": "c503c043-18ef-4c10-a0e7-591b3c3fc023"}]} {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:47:54.988070 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG dbcounter [-] [118158] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=118158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:47:54.994308 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [req-4e2a1a83-b0bb-4333-96ff-c889689ce542 req-9a47944c-5edf-486b-bb62-c5aa40e98dd6 service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:54.994692 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [req-4e2a1a83-b0bb-4333-96ff-c889689ce542 req-9a47944c-5edf-486b-bb62-c5aa40e98dd6 service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:55.006008 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.compute.server_external_events [req-4e2a1a83-b0bb-4333-96ff-c889689ce542 req-9a47944c-5edf-486b-bb62-c5aa40e98dd6 service nova] Creating event network-vif-deleted:c503c043-18ef-4c10-a0e7-591b3c3fc023 for instance 3636f852-d3ce-4505-b21b-3bbfac40d180 on hv-cinder-84497 Jun 07 14:47:55.011221 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [req-4e2a1a83-b0bb-4333-96ff-c889689ce542 req-9a47944c-5edf-486b-bb62-c5aa40e98dd6 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033057 Jun 07 14:47:55.011860 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 418/827] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jun 7 14:47:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:47:55.122385 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-bc3ec1aa-2c25-4f71-9cd5-7fb0b0ab4d43 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:47:55.124685 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-bc3ec1aa-2c25-4f71-9cd5-7fb0b0ab4d43 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 3636f852-d3ce-4505-b21b-3bbfac40d180] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:47:55.132681 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-bc3ec1aa-2c25-4f71-9cd5-7fb0b0ab4d43 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:55.133127 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-bc3ec1aa-2c25-4f71-9cd5-7fb0b0ab4d43 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:55.133911 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-bc3ec1aa-2c25-4f71-9cd5-7fb0b0ab4d43 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:55.134353 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-bc3ec1aa-2c25-4f71-9cd5-7fb0b0ab4d43 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:55.236120 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-bc3ec1aa-2c25-4f71-9cd5-7fb0b0ab4d43 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eb9ec1f3ff44bbb03cf934cb2a04de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eae64ee53144e4f8d583bb4288c0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:47:55.244031 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-bc3ec1aa-2c25-4f71-9cd5-7fb0b0ab4d43 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/3636f852-d3ce-4505-b21b-3bbfac40d180" status: 200 len: 1324 microversion: 2.1 time: 0.125990 Jun 07 14:47:55.244623 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 410/828] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:47:55 2022] GET /compute/v2.1/servers/3636f852-d3ce-4505-b21b-3bbfac40d180 => generated 1324 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:47:56.262232 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-3862557b-e6ff-4c2b-94d3-917141a39b70 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:47:56.266761 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-3862557b-e6ff-4c2b-94d3-917141a39b70 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 3636f852-d3ce-4505-b21b-3bbfac40d180] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:47:56.272544 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-3862557b-e6ff-4c2b-94d3-917141a39b70 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:56.272544 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-3862557b-e6ff-4c2b-94d3-917141a39b70 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:56.272544 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-3862557b-e6ff-4c2b-94d3-917141a39b70 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:47:56.272544 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-3862557b-e6ff-4c2b-94d3-917141a39b70 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:47:56.286022 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.wsgi [None req-3862557b-e6ff-4c2b-94d3-917141a39b70 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] HTTP exception thrown: Instance 3636f852-d3ce-4505-b21b-3bbfac40d180 could not be found. Jun 07 14:47:56.287770 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-3862557b-e6ff-4c2b-94d3-917141a39b70 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Request method failure captured: Jun 07 14:47:56.287770 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: request: GET /compute/v2.1/servers/3636f852-d3ce-4505-b21b-3bbfac40d180 HTTP/1.1 Jun 07 14:47:56.287770 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Accept: application/json Jun 07 14:47:56.287770 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Accept-Encoding: identity Jun 07 14:47:56.287770 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Connection: close Jun 07 14:47:56.287770 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Content-Length: 0 Jun 07 14:47:56.287770 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Content-Type: application/json Jun 07 14:47:56.287770 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Host: 10.222.0.85 Jun 07 14:47:56.287770 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Openstack-System-Scope: None Jun 07 14:47:56.287770 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: User-Agent: python-urllib3/1.26.9 Jun 07 14:47:56.287770 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Auth-Token: gAAAAABin2MfTRQCz8-nJ9l6FZbbvZHr4ehXByNi3Z0iSJmei7E9Un8HbsXaII7Zrv5LEnKmQb4d93wyNQqjAkp1IKVfs3yISIEXnMvfKr46BwDX3CxPmlHLkbdOk4RqVmIQcl_yARDnVkQjkCk9boV0Z6LD9SMz4Q7cu_osT-ds_ddwKKWxW2w Jun 07 14:47:56.287770 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Domain-Id: None Jun 07 14:47:56.287770 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Domain-Name: None Jun 07 14:47:56.287770 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Identity-Status: Confirmed Jun 07 14:47:56.287770 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Is-Admin-Project: True Jun 07 14:47:56.287770 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Domain-Id: default Jun 07 14:47:56.287770 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Domain-Name: Default Jun 07 14:47:56.287770 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Id: 8eae64ee53144e4f8d583bb4288c0aeb Jun 07 14:47:56.287770 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Name: tempest-AttachVolumeNegativeTest-1508033184 Jun 07 14:47:56.287770 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Role: member,reader Jun 07 14:47:56.287770 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Roles: member,reader Jun 07 14:47:56.289993 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8eae64ee53144e4f8d583bb4288c0aeb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_8eae64ee53144e4f8d583bb4288c0aeb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8eae64ee53144e4f8d583bb4288c0aeb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/8eae64ee53144e4f8d583bb4288c0aeb"}]}] Jun 07 14:47:56.289993 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Tenant: tempest-AttachVolumeNegativeTest-1508033184 Jun 07 14:47:56.289993 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Tenant-Id: 8eae64ee53144e4f8d583bb4288c0aeb Jun 07 14:47:56.289993 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1508033184 Jun 07 14:47:56.289993 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User: tempest-AttachVolumeNegativeTest-1508033184-project Jun 07 14:47:56.289993 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Domain-Id: default Jun 07 14:47:56.289993 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Domain-Name: Default Jun 07 14:47:56.289993 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Id: 34eb9ec1f3ff44bbb03cf934cb2a04de Jun 07 14:47:56.289993 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Name: tempest-AttachVolumeNegativeTest-1508033184-project Jun 07 14:47:56.289993 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: method: > Jun 07 14:47:56.289993 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: exception: Instance 3636f852-d3ce-4505-b21b-3bbfac40d180 could not be found. Jun 07 14:47:56.289993 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: action_args: {'id': '3636f852-d3ce-4505-b21b-3bbfac40d180'} Jun 07 14:47:56.290822 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:47:56.290822 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:47:56.290822 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 14:47:56.290822 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 14:47:56.290822 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 14:47:56.290822 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 14:47:56.290822 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 14:47:56.290822 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 14:47:56.290822 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 14:47:56.290822 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 14:47:56.290822 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3636f852-d3ce-4505-b21b-3bbfac40d180 could not be found. Jun 07 14:47:56.290822 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:47:56.290822 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:47:56.290822 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:47:56.290822 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:47:56.290822 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:47:56.290822 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:47:56.290822 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:47:56.290822 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:47:56.290822 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:47:56.292074 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:47:56.292074 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 14:47:56.292074 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 14:47:56.292074 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 14:47:56.292074 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 14:47:56.292074 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 14:47:56.292074 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:47:56.292074 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3636f852-d3ce-4505-b21b-3bbfac40d180 could not be found. Jun 07 14:47:56.292074 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:47:56.292074 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:47:56.292074 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:47:56.292074 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:47:56.292074 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:47:56.292074 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:47:56.292074 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:47:56.292074 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:47:56.292074 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3636f852-d3ce-4505-b21b-3bbfac40d180 could not be found. Jun 07 14:47:56.292074 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:47:56.293208 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-3862557b-e6ff-4c2b-94d3-917141a39b70 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Returning 404 to user: Instance 3636f852-d3ce-4505-b21b-3bbfac40d180 could not be found. {{(pid=118158) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:47:56.293208 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-3862557b-e6ff-4c2b-94d3-917141a39b70 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/3636f852-d3ce-4505-b21b-3bbfac40d180" status: 404 len: 111 microversion: 2.1 time: 0.032442 Jun 07 14:47:56.293208 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 419/829] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:47:56 2022] GET /compute/v2.1/servers/3636f852-d3ce-4505-b21b-3bbfac40d180 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 14:47:56.298943 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-94099583-ad05-4492-b36a-25405e12a6d7 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '.version_select at 0x7f5f880af1f0>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:47:56.433590 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-94099583-ad05-4492-b36a-25405e12a6d7 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-40951713" status: 202 len: 0 microversion: 2.1 time: 0.138665 Jun 07 14:47:56.434164 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 411/830] 10.222.0.85 () {58 vars in 1214 bytes} [Tue Jun 7 14:47:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-40951713 => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 14:47:57.196811 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-41165670-b6af-4891-9ca5-75c8aa1ce786 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Action: 'create', calling method: .version_select at 0x7f5f8807b160>, body: {"keypair": {"name": "tempest-keypair-1257354596", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOfNyn1LIIAKeqXLAfwKCarQKXIMDINV5VoUtJJ8sw8kYhHNfg8y/s1yYbvclfKb3T7JWJkFaEhUPq+rzeLjSZFD9ROm+X/R/+72BXKoc72SRxtYFoXScunTZzeSv2mUAQ=="}} {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:47:57.211733 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.quota [None req-41165670-b6af-4891-9ca5-75c8aa1ce786 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Getting quotas for project 8eae64ee53144e4f8d583bb4288c0aeb. Resources: {'key_pairs'} {{(pid=118158) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 14:47:57.215759 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.quota [None req-41165670-b6af-4891-9ca5-75c8aa1ce786 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Getting quotas for user 34eb9ec1f3ff44bbb03cf934cb2a04de and project 8eae64ee53144e4f8d583bb4288c0aeb. Resources: {'key_pairs'} {{(pid=118158) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 14:47:57.313492 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-41165670-b6af-4891-9ca5-75c8aa1ce786 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.121266 Jun 07 14:47:57.314159 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 420/831] 10.222.0.85 () {60 vars in 1158 bytes} [Tue Jun 7 14:47:57 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:47:59.936936 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-c6b40c4f-a470-4482-8cc3-3f7d912c6933 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-114404256", "imageRef": "7802ce25-d370-43a3-8d85-0257d644d539", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "52ef821c-7cda-47a1-a169-1a51a76fefad"}], "security_groups": [{"name": "tempest-securitygroup--869418693"}], "key_name": "tempest-keypair-1257354596", "user_data": "}} {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:48:00.042420 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.network.neutron [None req-c6b40c4f-a470-4482-8cc3-3f7d912c6933 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] validate_networks() for [('52ef821c-7cda-47a1-a169-1a51a76fefad', None, None, None, None, None)] {{(pid=118157) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 14:48:00.410893 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.virt.hardware [None req-c6b40c4f-a470-4482-8cc3-3f7d912c6933 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Flavor limits 0:0:0 {{(pid=118157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 14:48:00.411321 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.virt.hardware [None req-c6b40c4f-a470-4482-8cc3-3f7d912c6933 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Image limits 0:0:0 {{(pid=118157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 14:48:00.411799 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.virt.hardware [None req-c6b40c4f-a470-4482-8cc3-3f7d912c6933 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Flavor pref 0:0:0 {{(pid=118157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 14:48:00.412212 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.virt.hardware [None req-c6b40c4f-a470-4482-8cc3-3f7d912c6933 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Image pref 0:0:0 {{(pid=118157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 14:48:00.412681 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.virt.hardware [None req-c6b40c4f-a470-4482-8cc3-3f7d912c6933 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 14:48:00.423427 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-c6b40c4f-a470-4482-8cc3-3f7d912c6933 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:00.423908 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-c6b40c4f-a470-4482-8cc3-3f7d912c6933 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:00.424709 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-c6b40c4f-a470-4482-8cc3-3f7d912c6933 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:00.425142 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-c6b40c4f-a470-4482-8cc3-3f7d912c6933 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:00.442178 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.quota [None req-c6b40c4f-a470-4482-8cc3-3f7d912c6933 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Getting quotas for project 8eae64ee53144e4f8d583bb4288c0aeb. Resources: {'instances', 'cores', 'ram'} {{(pid=118157) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 14:48:00.446162 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.quota [None req-c6b40c4f-a470-4482-8cc3-3f7d912c6933 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Getting quotas for user 34eb9ec1f3ff44bbb03cf934cb2a04de and project 8eae64ee53144e4f8d583bb4288c0aeb. Resources: {'instances', 'cores', 'ram'} {{(pid=118157) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 14:48:00.457492 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-c6b40c4f-a470-4482-8cc3-3f7d912c6933 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Going to run 1 instances... {{(pid=118157) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 14:48:00.459776 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-c6b40c4f-a470-4482-8cc3-3f7d912c6933 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 46299ff5-499b-4ec8-b2d5-f876e3303a07] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7802ce25-d370-43a3-8d85-0257d644d539',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118157) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 14:48:00.645691 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-c6b40c4f-a470-4482-8cc3-3f7d912c6933 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.713994 Jun 07 14:48:00.646480 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 412/832] 10.222.0.85 () {60 vars in 1146 bytes} [Tue Jun 7 14:47:59 2022] POST /compute/v2.1/servers => generated 401 bytes in 716 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 14:48:00.658121 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-87d4df47-97c4-4b48-bc87-84d617fd51d0 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:48:00.666281 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-87d4df47-97c4-4b48-bc87-84d617fd51d0 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 46299ff5-499b-4ec8-b2d5-f876e3303a07] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:48:00.725832 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-87d4df47-97c4-4b48-bc87-84d617fd51d0 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eb9ec1f3ff44bbb03cf934cb2a04de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eae64ee53144e4f8d583bb4288c0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:00.734135 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-87d4df47-97c4-4b48-bc87-84d617fd51d0 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/46299ff5-499b-4ec8-b2d5-f876e3303a07" status: 200 len: 1241 microversion: 2.1 time: 0.080417 Jun 07 14:48:00.734922 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 421/833] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:48:00 2022] GET /compute/v2.1/servers/46299ff5-499b-4ec8-b2d5-f876e3303a07 => generated 1241 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:48:01.753227 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-5f0acb0a-d9e5-401b-8cbb-47f03b5c44ba tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:48:01.753878 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-5f0acb0a-d9e5-401b-8cbb-47f03b5c44ba tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 46299ff5-499b-4ec8-b2d5-f876e3303a07] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:48:01.764701 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-5f0acb0a-d9e5-401b-8cbb-47f03b5c44ba tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:01.765385 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-5f0acb0a-d9e5-401b-8cbb-47f03b5c44ba tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:01.766174 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-5f0acb0a-d9e5-401b-8cbb-47f03b5c44ba tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:01.766816 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-5f0acb0a-d9e5-401b-8cbb-47f03b5c44ba tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:01.836307 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-5f0acb0a-d9e5-401b-8cbb-47f03b5c44ba tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eb9ec1f3ff44bbb03cf934cb2a04de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eae64ee53144e4f8d583bb4288c0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:01.846572 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-5f0acb0a-d9e5-401b-8cbb-47f03b5c44ba tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/46299ff5-499b-4ec8-b2d5-f876e3303a07" status: 200 len: 1245 microversion: 2.1 time: 0.097194 Jun 07 14:48:01.847418 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 413/834] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:48:01 2022] GET /compute/v2.1/servers/46299ff5-499b-4ec8-b2d5-f876e3303a07 => generated 1245 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:48:02.862956 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-ba02348c-bbc0-4f6d-af89-0eecea84f245 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:48:02.863565 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-ba02348c-bbc0-4f6d-af89-0eecea84f245 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 46299ff5-499b-4ec8-b2d5-f876e3303a07] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:48:02.870499 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-ba02348c-bbc0-4f6d-af89-0eecea84f245 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:02.871194 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-ba02348c-bbc0-4f6d-af89-0eecea84f245 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:02.872143 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-ba02348c-bbc0-4f6d-af89-0eecea84f245 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:02.872758 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-ba02348c-bbc0-4f6d-af89-0eecea84f245 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:02.959130 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-ba02348c-bbc0-4f6d-af89-0eecea84f245 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eb9ec1f3ff44bbb03cf934cb2a04de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eae64ee53144e4f8d583bb4288c0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:02.967097 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-ba02348c-bbc0-4f6d-af89-0eecea84f245 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/46299ff5-499b-4ec8-b2d5-f876e3303a07" status: 200 len: 1301 microversion: 2.1 time: 0.107883 Jun 07 14:48:02.967668 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 422/835] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:48:02 2022] GET /compute/v2.1/servers/46299ff5-499b-4ec8-b2d5-f876e3303a07 => generated 1301 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:48:03.990101 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-3e6c6528-b314-4294-869c-bf535bbe23c4 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:48:03.992908 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-3e6c6528-b314-4294-869c-bf535bbe23c4 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 46299ff5-499b-4ec8-b2d5-f876e3303a07] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:48:04.003640 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-3e6c6528-b314-4294-869c-bf535bbe23c4 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:04.009355 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-3e6c6528-b314-4294-869c-bf535bbe23c4 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:04.010177 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-3e6c6528-b314-4294-869c-bf535bbe23c4 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:04.010625 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-3e6c6528-b314-4294-869c-bf535bbe23c4 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:04.041119 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-d014de37-a36b-4292-ad66-ba3f31124536 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-891798729", "imageRef": "7802ce25-d370-43a3-8d85-0257d644d539", "flavorRef": "452"}} {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:48:04.098466 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.network.neutron [None req-d014de37-a36b-4292-ad66-ba3f31124536 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] validate_networks() for None {{(pid=118158) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 14:48:04.153217 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-3e6c6528-b314-4294-869c-bf535bbe23c4 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eb9ec1f3ff44bbb03cf934cb2a04de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eae64ee53144e4f8d583bb4288c0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:04.161114 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-3e6c6528-b314-4294-869c-bf535bbe23c4 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/46299ff5-499b-4ec8-b2d5-f876e3303a07" status: 200 len: 1366 microversion: 2.1 time: 0.180154 Jun 07 14:48:04.162062 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 414/836] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:48:03 2022] GET /compute/v2.1/servers/46299ff5-499b-4ec8-b2d5-f876e3303a07 => generated 1366 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:48:04.490376 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.virt.hardware [None req-d014de37-a36b-4292-ad66-ba3f31124536 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Flavor limits 0:0:0 {{(pid=118158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 14:48:04.490804 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.virt.hardware [None req-d014de37-a36b-4292-ad66-ba3f31124536 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Image limits 0:0:0 {{(pid=118158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 14:48:04.491279 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.virt.hardware [None req-d014de37-a36b-4292-ad66-ba3f31124536 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Flavor pref 0:0:0 {{(pid=118158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 14:48:04.491709 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.virt.hardware [None req-d014de37-a36b-4292-ad66-ba3f31124536 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Image pref 0:0:0 {{(pid=118158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 14:48:04.492106 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.virt.hardware [None req-d014de37-a36b-4292-ad66-ba3f31124536 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 14:48:04.500972 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-d014de37-a36b-4292-ad66-ba3f31124536 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:04.501481 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-d014de37-a36b-4292-ad66-ba3f31124536 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:04.502281 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-d014de37-a36b-4292-ad66-ba3f31124536 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:04.502878 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-d014de37-a36b-4292-ad66-ba3f31124536 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:04.520219 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.quota [None req-d014de37-a36b-4292-ad66-ba3f31124536 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Getting quotas for project 4828df5e016c42bfa253b68f732f99cb. Resources: {'instances', 'cores', 'ram'} {{(pid=118158) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 14:48:04.524633 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.quota [None req-d014de37-a36b-4292-ad66-ba3f31124536 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Getting quotas for user 2684a7ce412b4124af2155c516b69966 and project 4828df5e016c42bfa253b68f732f99cb. Resources: {'instances', 'cores', 'ram'} {{(pid=118158) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 14:48:04.537617 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-d014de37-a36b-4292-ad66-ba3f31124536 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Going to run 1 instances... {{(pid=118158) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 14:48:04.540095 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-d014de37-a36b-4292-ad66-ba3f31124536 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] [instance: 30004414-0945-4eb6-b528-12c871a30aba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7802ce25-d370-43a3-8d85-0257d644d539',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118158) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 14:48:04.640661 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-d014de37-a36b-4292-ad66-ba3f31124536 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.603453 Jun 07 14:48:04.641996 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 423/837] 10.222.0.85 () {60 vars in 1146 bytes} [Tue Jun 7 14:48:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 606 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 07 14:48:04.652715 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-d03a8646-3f12-4a4d-a652-12331398d84b tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:48:04.653373 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-d03a8646-3f12-4a4d-a652-12331398d84b tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] [instance: 30004414-0945-4eb6-b528-12c871a30aba] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:48:04.728782 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-d03a8646-3f12-4a4d-a652-12331398d84b tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2684a7ce412b4124af2155c516b69966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4828df5e016c42bfa253b68f732f99cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:04.743100 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-d03a8646-3f12-4a4d-a652-12331398d84b tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] 10.222.0.85 "GET /compute/v2.1/servers/30004414-0945-4eb6-b528-12c871a30aba" status: 200 len: 1214 microversion: 2.1 time: 0.095041 Jun 07 14:48:04.743689 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 415/838] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:48:04 2022] GET /compute/v2.1/servers/30004414-0945-4eb6-b528-12c871a30aba => generated 1214 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:48:05.121645 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [req-e166d055-595e-49ba-9869-24b70d1be964 req-daf98e17-68fa-4d07-9a6e-a55f6a120708 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46299ff5-499b-4ec8-b2d5-f876e3303a07", "tag": "67def1cd-fa4f-4a3a-80bf-96a2c73f57b0"}]} {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:48:05.132027 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [req-e166d055-595e-49ba-9869-24b70d1be964 req-daf98e17-68fa-4d07-9a6e-a55f6a120708 service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:05.132585 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [req-e166d055-595e-49ba-9869-24b70d1be964 req-daf98e17-68fa-4d07-9a6e-a55f6a120708 service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:05.152288 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.compute.server_external_events [req-e166d055-595e-49ba-9869-24b70d1be964 req-daf98e17-68fa-4d07-9a6e-a55f6a120708 service nova] Creating event network-changed:67def1cd-fa4f-4a3a-80bf-96a2c73f57b0 for instance 46299ff5-499b-4ec8-b2d5-f876e3303a07 on hv-cinder-84497 Jun 07 14:48:05.158082 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [req-e166d055-595e-49ba-9869-24b70d1be964 req-daf98e17-68fa-4d07-9a6e-a55f6a120708 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043080 Jun 07 14:48:05.158728 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 424/839] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jun 7 14:48:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:48:05.184053 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-ae15fb2b-93b2-4a09-9d95-229a2b4993e1 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:48:05.184053 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-ae15fb2b-93b2-4a09-9d95-229a2b4993e1 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 46299ff5-499b-4ec8-b2d5-f876e3303a07] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:48:05.208973 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-ae15fb2b-93b2-4a09-9d95-229a2b4993e1 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:05.209507 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-ae15fb2b-93b2-4a09-9d95-229a2b4993e1 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:05.212184 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-ae15fb2b-93b2-4a09-9d95-229a2b4993e1 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:05.212184 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-ae15fb2b-93b2-4a09-9d95-229a2b4993e1 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:05.364121 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-ae15fb2b-93b2-4a09-9d95-229a2b4993e1 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eb9ec1f3ff44bbb03cf934cb2a04de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eae64ee53144e4f8d583bb4288c0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:05.378713 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-ae15fb2b-93b2-4a09-9d95-229a2b4993e1 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/46299ff5-499b-4ec8-b2d5-f876e3303a07" status: 200 len: 1366 microversion: 2.1 time: 0.197188 Jun 07 14:48:05.378713 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 416/840] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:48:05 2022] GET /compute/v2.1/servers/46299ff5-499b-4ec8-b2d5-f876e3303a07 => generated 1366 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:48:05.763524 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-d2daef5a-36d2-41eb-82de-d8129d3a5567 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:48:05.764120 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-d2daef5a-36d2-41eb-82de-d8129d3a5567 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] [instance: 30004414-0945-4eb6-b528-12c871a30aba] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:48:05.771235 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-d2daef5a-36d2-41eb-82de-d8129d3a5567 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:05.772200 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-d2daef5a-36d2-41eb-82de-d8129d3a5567 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:05.773556 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-d2daef5a-36d2-41eb-82de-d8129d3a5567 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:05.774001 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-d2daef5a-36d2-41eb-82de-d8129d3a5567 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:05.857067 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-d2daef5a-36d2-41eb-82de-d8129d3a5567 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2684a7ce412b4124af2155c516b69966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4828df5e016c42bfa253b68f732f99cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:05.868631 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-d2daef5a-36d2-41eb-82de-d8129d3a5567 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] 10.222.0.85 "GET /compute/v2.1/servers/30004414-0945-4eb6-b528-12c871a30aba" status: 200 len: 1218 microversion: 2.1 time: 0.109848 Jun 07 14:48:05.869375 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 425/841] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:48:05 2022] GET /compute/v2.1/servers/30004414-0945-4eb6-b528-12c871a30aba => generated 1218 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:48:06.388894 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-4328e1c1-cf02-49c4-924b-f988472f3222 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:48:06.389573 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-4328e1c1-cf02-49c4-924b-f988472f3222 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 46299ff5-499b-4ec8-b2d5-f876e3303a07] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:48:06.396234 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-4328e1c1-cf02-49c4-924b-f988472f3222 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:06.396710 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-4328e1c1-cf02-49c4-924b-f988472f3222 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:06.397485 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-4328e1c1-cf02-49c4-924b-f988472f3222 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:06.398173 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-4328e1c1-cf02-49c4-924b-f988472f3222 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:06.531741 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-4328e1c1-cf02-49c4-924b-f988472f3222 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eb9ec1f3ff44bbb03cf934cb2a04de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eae64ee53144e4f8d583bb4288c0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:06.540669 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-4328e1c1-cf02-49c4-924b-f988472f3222 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/46299ff5-499b-4ec8-b2d5-f876e3303a07" status: 200 len: 1366 microversion: 2.1 time: 0.155616 Jun 07 14:48:06.541248 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 417/842] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:48:06 2022] GET /compute/v2.1/servers/46299ff5-499b-4ec8-b2d5-f876e3303a07 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:48:06.886310 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-43d5e4e6-f3c3-449a-81e0-0d8c981921f3 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:48:06.887420 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-43d5e4e6-f3c3-449a-81e0-0d8c981921f3 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] [instance: 30004414-0945-4eb6-b528-12c871a30aba] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:48:06.894002 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-43d5e4e6-f3c3-449a-81e0-0d8c981921f3 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:06.894450 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-43d5e4e6-f3c3-449a-81e0-0d8c981921f3 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:06.895220 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-43d5e4e6-f3c3-449a-81e0-0d8c981921f3 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:06.895656 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-43d5e4e6-f3c3-449a-81e0-0d8c981921f3 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:06.958507 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-43d5e4e6-f3c3-449a-81e0-0d8c981921f3 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2684a7ce412b4124af2155c516b69966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4828df5e016c42bfa253b68f732f99cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:06.966042 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-43d5e4e6-f3c3-449a-81e0-0d8c981921f3 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] 10.222.0.85 "GET /compute/v2.1/servers/30004414-0945-4eb6-b528-12c871a30aba" status: 200 len: 1210 microversion: 2.1 time: 0.083601 Jun 07 14:48:06.966621 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 426/843] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:48:06 2022] GET /compute/v2.1/servers/30004414-0945-4eb6-b528-12c871a30aba => generated 1210 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:48:07.558131 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-514270d7-ccb3-4ab8-bf5e-589f8442894e tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:48:07.559330 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-514270d7-ccb3-4ab8-bf5e-589f8442894e tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 46299ff5-499b-4ec8-b2d5-f876e3303a07] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:48:07.565751 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-514270d7-ccb3-4ab8-bf5e-589f8442894e tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:07.566224 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-514270d7-ccb3-4ab8-bf5e-589f8442894e tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:07.566985 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-514270d7-ccb3-4ab8-bf5e-589f8442894e tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:07.567430 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-514270d7-ccb3-4ab8-bf5e-589f8442894e tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:07.698186 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-514270d7-ccb3-4ab8-bf5e-589f8442894e tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eb9ec1f3ff44bbb03cf934cb2a04de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eae64ee53144e4f8d583bb4288c0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:07.706139 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-514270d7-ccb3-4ab8-bf5e-589f8442894e tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/46299ff5-499b-4ec8-b2d5-f876e3303a07" status: 200 len: 1366 microversion: 2.1 time: 0.151877 Jun 07 14:48:07.706695 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 418/844] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:48:07 2022] GET /compute/v2.1/servers/46299ff5-499b-4ec8-b2d5-f876e3303a07 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:48:07.984474 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-35cdd8a7-980d-4611-a35b-7ad4dded9d0e tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:48:07.985092 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-35cdd8a7-980d-4611-a35b-7ad4dded9d0e tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] [instance: 30004414-0945-4eb6-b528-12c871a30aba] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:48:07.991744 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-35cdd8a7-980d-4611-a35b-7ad4dded9d0e tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:07.992192 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-35cdd8a7-980d-4611-a35b-7ad4dded9d0e tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:07.992993 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-35cdd8a7-980d-4611-a35b-7ad4dded9d0e tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:07.993428 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-35cdd8a7-980d-4611-a35b-7ad4dded9d0e tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:08.054004 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-35cdd8a7-980d-4611-a35b-7ad4dded9d0e tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2684a7ce412b4124af2155c516b69966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4828df5e016c42bfa253b68f732f99cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:08.061475 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-35cdd8a7-980d-4611-a35b-7ad4dded9d0e tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] 10.222.0.85 "GET /compute/v2.1/servers/30004414-0945-4eb6-b528-12c871a30aba" status: 200 len: 1210 microversion: 2.1 time: 0.082325 Jun 07 14:48:08.062032 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 427/845] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:48:07 2022] GET /compute/v2.1/servers/30004414-0945-4eb6-b528-12c871a30aba => generated 1210 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:48:08.722974 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-93af0c0f-ba36-4427-a533-5aa699388d43 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:48:08.723598 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-93af0c0f-ba36-4427-a533-5aa699388d43 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 46299ff5-499b-4ec8-b2d5-f876e3303a07] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:48:08.729837 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-93af0c0f-ba36-4427-a533-5aa699388d43 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:08.730292 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-93af0c0f-ba36-4427-a533-5aa699388d43 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:08.731058 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-93af0c0f-ba36-4427-a533-5aa699388d43 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:08.732141 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-93af0c0f-ba36-4427-a533-5aa699388d43 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:08.859801 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-93af0c0f-ba36-4427-a533-5aa699388d43 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eb9ec1f3ff44bbb03cf934cb2a04de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eae64ee53144e4f8d583bb4288c0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:08.867179 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-93af0c0f-ba36-4427-a533-5aa699388d43 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/46299ff5-499b-4ec8-b2d5-f876e3303a07" status: 200 len: 1366 microversion: 2.1 time: 0.148010 Jun 07 14:48:08.867905 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 419/846] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:48:08 2022] GET /compute/v2.1/servers/46299ff5-499b-4ec8-b2d5-f876e3303a07 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:48:09.078180 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-c874aac9-c149-4b08-9bae-720ef220b8a9 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:48:09.078748 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-c874aac9-c149-4b08-9bae-720ef220b8a9 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] [instance: 30004414-0945-4eb6-b528-12c871a30aba] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:48:09.085308 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-c874aac9-c149-4b08-9bae-720ef220b8a9 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:09.085760 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-c874aac9-c149-4b08-9bae-720ef220b8a9 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:09.086857 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-c874aac9-c149-4b08-9bae-720ef220b8a9 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:09.087301 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-c874aac9-c149-4b08-9bae-720ef220b8a9 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:09.166253 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-c874aac9-c149-4b08-9bae-720ef220b8a9 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2684a7ce412b4124af2155c516b69966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4828df5e016c42bfa253b68f732f99cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:09.175349 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-c874aac9-c149-4b08-9bae-720ef220b8a9 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] 10.222.0.85 "GET /compute/v2.1/servers/30004414-0945-4eb6-b528-12c871a30aba" status: 200 len: 1274 microversion: 2.1 time: 0.101070 Jun 07 14:48:09.176128 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 428/847] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:48:09 2022] GET /compute/v2.1/servers/30004414-0945-4eb6-b528-12c871a30aba => generated 1274 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:48:09.883675 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-57401ef3-464e-4bf1-9b31-b58a217413ce tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:48:09.884217 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-57401ef3-464e-4bf1-9b31-b58a217413ce tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 46299ff5-499b-4ec8-b2d5-f876e3303a07] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:48:09.890959 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-57401ef3-464e-4bf1-9b31-b58a217413ce tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:09.891421 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-57401ef3-464e-4bf1-9b31-b58a217413ce tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:09.892619 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-57401ef3-464e-4bf1-9b31-b58a217413ce tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:09.893074 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-57401ef3-464e-4bf1-9b31-b58a217413ce tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:10.136864 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-57401ef3-464e-4bf1-9b31-b58a217413ce tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eb9ec1f3ff44bbb03cf934cb2a04de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eae64ee53144e4f8d583bb4288c0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:10.136864 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-57401ef3-464e-4bf1-9b31-b58a217413ce tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/46299ff5-499b-4ec8-b2d5-f876e3303a07" status: 200 len: 1366 microversion: 2.1 time: 0.161348 Jun 07 14:48:10.136864 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 420/848] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:48:09 2022] GET /compute/v2.1/servers/46299ff5-499b-4ec8-b2d5-f876e3303a07 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:48:10.207173 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-b313b634-bd8f-4224-b862-dc3459f196a1 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:48:10.207173 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-b313b634-bd8f-4224-b862-dc3459f196a1 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] [instance: 30004414-0945-4eb6-b528-12c871a30aba] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:48:10.207173 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-b313b634-bd8f-4224-b862-dc3459f196a1 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:10.207173 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-b313b634-bd8f-4224-b862-dc3459f196a1 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:10.207919 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-b313b634-bd8f-4224-b862-dc3459f196a1 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:10.207919 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-b313b634-bd8f-4224-b862-dc3459f196a1 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:10.387308 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-b313b634-bd8f-4224-b862-dc3459f196a1 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2684a7ce412b4124af2155c516b69966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4828df5e016c42bfa253b68f732f99cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:10.396500 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-b313b634-bd8f-4224-b862-dc3459f196a1 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] 10.222.0.85 "GET /compute/v2.1/servers/30004414-0945-4eb6-b528-12c871a30aba" status: 200 len: 1314 microversion: 2.1 time: 0.208482 Jun 07 14:48:10.397076 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 429/849] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:48:10 2022] GET /compute/v2.1/servers/30004414-0945-4eb6-b528-12c871a30aba => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:48:11.058022 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-7a38b1fa-83c4-4965-9e56-f8c4302eb84e tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:48:11.058694 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-7a38b1fa-83c4-4965-9e56-f8c4302eb84e tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 46299ff5-499b-4ec8-b2d5-f876e3303a07] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:48:11.060522 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG dbcounter [-] [118157] Writing DB stats nova_cell0:SELECT=2 {{(pid=118157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:48:11.065853 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-7a38b1fa-83c4-4965-9e56-f8c4302eb84e tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:11.066304 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-7a38b1fa-83c4-4965-9e56-f8c4302eb84e tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:11.067157 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-7a38b1fa-83c4-4965-9e56-f8c4302eb84e tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:11.067599 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-7a38b1fa-83c4-4965-9e56-f8c4302eb84e tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:11.203614 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-7a38b1fa-83c4-4965-9e56-f8c4302eb84e tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eb9ec1f3ff44bbb03cf934cb2a04de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eae64ee53144e4f8d583bb4288c0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:11.216679 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [req-80e0c126-1003-4c5c-b3e6-35a893003aad req-464fa70d-b39c-496f-aa96-feef34754f17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30004414-0945-4eb6-b528-12c871a30aba", "tag": "24279771-a44a-4f91-a145-80032be76755"}]} {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:48:11.220714 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-7a38b1fa-83c4-4965-9e56-f8c4302eb84e tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/46299ff5-499b-4ec8-b2d5-f876e3303a07" status: 200 len: 1366 microversion: 2.1 time: 0.166303 Jun 07 14:48:11.221618 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 421/850] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:48:11 2022] GET /compute/v2.1/servers/46299ff5-499b-4ec8-b2d5-f876e3303a07 => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:48:11.230967 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [req-80e0c126-1003-4c5c-b3e6-35a893003aad req-464fa70d-b39c-496f-aa96-feef34754f17 service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:11.232133 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [req-80e0c126-1003-4c5c-b3e6-35a893003aad req-464fa70d-b39c-496f-aa96-feef34754f17 service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:11.243923 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.compute.server_external_events [req-80e0c126-1003-4c5c-b3e6-35a893003aad req-464fa70d-b39c-496f-aa96-feef34754f17 service nova] Creating event network-changed:24279771-a44a-4f91-a145-80032be76755 for instance 30004414-0945-4eb6-b528-12c871a30aba on hv-cinder-84497 Jun 07 14:48:11.249033 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [req-80e0c126-1003-4c5c-b3e6-35a893003aad req-464fa70d-b39c-496f-aa96-feef34754f17 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037664 Jun 07 14:48:11.249842 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 430/851] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jun 7 14:48:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 14:48:11.421264 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-13e1dc40-a0e6-4307-a5f2-cece15283416 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:48:11.422107 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-13e1dc40-a0e6-4307-a5f2-cece15283416 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] [instance: 30004414-0945-4eb6-b528-12c871a30aba] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:48:11.428149 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-13e1dc40-a0e6-4307-a5f2-cece15283416 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:11.429152 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-13e1dc40-a0e6-4307-a5f2-cece15283416 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:11.429407 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-13e1dc40-a0e6-4307-a5f2-cece15283416 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:11.429847 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-13e1dc40-a0e6-4307-a5f2-cece15283416 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:11.567572 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-13e1dc40-a0e6-4307-a5f2-cece15283416 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2684a7ce412b4124af2155c516b69966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4828df5e016c42bfa253b68f732f99cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:11.577178 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-13e1dc40-a0e6-4307-a5f2-cece15283416 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] 10.222.0.85 "GET /compute/v2.1/servers/30004414-0945-4eb6-b528-12c871a30aba" status: 200 len: 1314 microversion: 2.1 time: 0.159891 Jun 07 14:48:11.577751 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 422/852] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:48:11 2022] GET /compute/v2.1/servers/30004414-0945-4eb6-b528-12c871a30aba => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:48:12.238133 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-15a32630-a532-49d9-8f3a-a78f32afe284 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:48:12.238864 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-15a32630-a532-49d9-8f3a-a78f32afe284 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 46299ff5-499b-4ec8-b2d5-f876e3303a07] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:48:12.245553 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-15a32630-a532-49d9-8f3a-a78f32afe284 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:12.246879 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-15a32630-a532-49d9-8f3a-a78f32afe284 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:12.246879 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-15a32630-a532-49d9-8f3a-a78f32afe284 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:12.247228 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-15a32630-a532-49d9-8f3a-a78f32afe284 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:12.339294 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [req-b612767b-ab53-47f0-a1ca-cc4b09715e9a req-920b9768-4a08-4620-b54f-b9a8600b3eda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46299ff5-499b-4ec8-b2d5-f876e3303a07", "name": "network-vif-plugged", "status": "completed", "tag": "67def1cd-fa4f-4a3a-80bf-96a2c73f57b0"}]} {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:48:12.348469 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [req-b612767b-ab53-47f0-a1ca-cc4b09715e9a req-920b9768-4a08-4620-b54f-b9a8600b3eda service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:12.348915 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [req-b612767b-ab53-47f0-a1ca-cc4b09715e9a req-920b9768-4a08-4620-b54f-b9a8600b3eda service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:12.360895 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.compute.server_external_events [req-b612767b-ab53-47f0-a1ca-cc4b09715e9a req-920b9768-4a08-4620-b54f-b9a8600b3eda service nova] Creating event network-vif-plugged:67def1cd-fa4f-4a3a-80bf-96a2c73f57b0 for instance 46299ff5-499b-4ec8-b2d5-f876e3303a07 on hv-cinder-84497 Jun 07 14:48:12.365980 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [req-b612767b-ab53-47f0-a1ca-cc4b09715e9a req-920b9768-4a08-4620-b54f-b9a8600b3eda service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030307 Jun 07 14:48:12.366623 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 423/853] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jun 7 14:48:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 14:48:12.381552 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-15a32630-a532-49d9-8f3a-a78f32afe284 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eb9ec1f3ff44bbb03cf934cb2a04de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eae64ee53144e4f8d583bb4288c0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:12.389704 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-15a32630-a532-49d9-8f3a-a78f32afe284 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/46299ff5-499b-4ec8-b2d5-f876e3303a07" status: 200 len: 1366 microversion: 2.1 time: 0.155806 Jun 07 14:48:12.390250 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 431/854] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:48:12 2022] GET /compute/v2.1/servers/46299ff5-499b-4ec8-b2d5-f876e3303a07 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:48:12.594685 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-693dfb65-284e-40b7-b169-7130efff7897 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:48:12.595402 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-693dfb65-284e-40b7-b169-7130efff7897 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] [instance: 30004414-0945-4eb6-b528-12c871a30aba] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:48:12.601566 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-693dfb65-284e-40b7-b169-7130efff7897 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:12.602017 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-693dfb65-284e-40b7-b169-7130efff7897 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:12.602770 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-693dfb65-284e-40b7-b169-7130efff7897 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:12.603229 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-693dfb65-284e-40b7-b169-7130efff7897 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:12.607729 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG dbcounter [-] [118157] Writing DB stats nova_cell1:SELECT=100 {{(pid=118157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:48:12.739087 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-693dfb65-284e-40b7-b169-7130efff7897 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2684a7ce412b4124af2155c516b69966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4828df5e016c42bfa253b68f732f99cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:12.742394 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-693dfb65-284e-40b7-b169-7130efff7897 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] 10.222.0.85 "GET /compute/v2.1/servers/30004414-0945-4eb6-b528-12c871a30aba" status: 200 len: 1314 microversion: 2.1 time: 0.151911 Jun 07 14:48:12.742973 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 424/855] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:48:12 2022] GET /compute/v2.1/servers/30004414-0945-4eb6-b528-12c871a30aba => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:48:13.406744 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-87b9592f-3d4e-4e37-a81e-cffeb2df50cf tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:48:13.407297 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-87b9592f-3d4e-4e37-a81e-cffeb2df50cf tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 46299ff5-499b-4ec8-b2d5-f876e3303a07] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:48:13.413823 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-87b9592f-3d4e-4e37-a81e-cffeb2df50cf tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:13.414268 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-87b9592f-3d4e-4e37-a81e-cffeb2df50cf tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:13.415029 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-87b9592f-3d4e-4e37-a81e-cffeb2df50cf tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:13.415466 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-87b9592f-3d4e-4e37-a81e-cffeb2df50cf tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:13.552417 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-87b9592f-3d4e-4e37-a81e-cffeb2df50cf tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eb9ec1f3ff44bbb03cf934cb2a04de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eae64ee53144e4f8d583bb4288c0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:13.560413 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-87b9592f-3d4e-4e37-a81e-cffeb2df50cf tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/46299ff5-499b-4ec8-b2d5-f876e3303a07" status: 200 len: 1366 microversion: 2.1 time: 0.157531 Jun 07 14:48:13.561659 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 432/856] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:48:13 2022] GET /compute/v2.1/servers/46299ff5-499b-4ec8-b2d5-f876e3303a07 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:48:13.759166 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-83626d9c-0de2-4d5e-a40b-6dbbb409e467 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:48:13.759761 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-83626d9c-0de2-4d5e-a40b-6dbbb409e467 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] [instance: 30004414-0945-4eb6-b528-12c871a30aba] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:48:13.766320 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-83626d9c-0de2-4d5e-a40b-6dbbb409e467 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:13.766766 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-83626d9c-0de2-4d5e-a40b-6dbbb409e467 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:13.767524 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-83626d9c-0de2-4d5e-a40b-6dbbb409e467 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:13.767952 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-83626d9c-0de2-4d5e-a40b-6dbbb409e467 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:13.896899 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-83626d9c-0de2-4d5e-a40b-6dbbb409e467 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2684a7ce412b4124af2155c516b69966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4828df5e016c42bfa253b68f732f99cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:13.905533 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-83626d9c-0de2-4d5e-a40b-6dbbb409e467 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] 10.222.0.85 "GET /compute/v2.1/servers/30004414-0945-4eb6-b528-12c871a30aba" status: 200 len: 1314 microversion: 2.1 time: 0.150122 Jun 07 14:48:13.906100 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 425/857] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:48:13 2022] GET /compute/v2.1/servers/30004414-0945-4eb6-b528-12c871a30aba => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:48:14.578301 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-849184a1-0d13-40b3-95f1-ca700874d1b3 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:48:14.578935 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-849184a1-0d13-40b3-95f1-ca700874d1b3 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 46299ff5-499b-4ec8-b2d5-f876e3303a07] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:48:14.581308 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG dbcounter [-] [118158] Writing DB stats nova_cell0:SELECT=2 {{(pid=118158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:48:14.581975 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG dbcounter [-] [118158] Writing DB stats nova_cell0:SELECT=12 {{(pid=118158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:48:14.587081 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-849184a1-0d13-40b3-95f1-ca700874d1b3 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:14.590635 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-849184a1-0d13-40b3-95f1-ca700874d1b3 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:14.590635 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-849184a1-0d13-40b3-95f1-ca700874d1b3 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:14.590635 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-849184a1-0d13-40b3-95f1-ca700874d1b3 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:14.781087 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-849184a1-0d13-40b3-95f1-ca700874d1b3 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eb9ec1f3ff44bbb03cf934cb2a04de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eae64ee53144e4f8d583bb4288c0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:14.783441 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG dbcounter [-] [118158] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:48:14.789232 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-849184a1-0d13-40b3-95f1-ca700874d1b3 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/46299ff5-499b-4ec8-b2d5-f876e3303a07" status: 200 len: 1366 microversion: 2.1 time: 0.215521 Jun 07 14:48:14.793669 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 433/858] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:48:14 2022] GET /compute/v2.1/servers/46299ff5-499b-4ec8-b2d5-f876e3303a07 => generated 1366 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:48:14.922976 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-65608453-3c9d-42c7-a209-7ca4840329d4 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:48:14.923536 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-65608453-3c9d-42c7-a209-7ca4840329d4 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] [instance: 30004414-0945-4eb6-b528-12c871a30aba] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:48:14.925475 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG dbcounter [-] [118157] Writing DB stats nova_cell0:SELECT=8 {{(pid=118157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:48:14.930745 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-65608453-3c9d-42c7-a209-7ca4840329d4 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:14.931195 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-65608453-3c9d-42c7-a209-7ca4840329d4 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:14.932022 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-65608453-3c9d-42c7-a209-7ca4840329d4 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:14.932404 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-65608453-3c9d-42c7-a209-7ca4840329d4 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:15.063406 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-65608453-3c9d-42c7-a209-7ca4840329d4 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2684a7ce412b4124af2155c516b69966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4828df5e016c42bfa253b68f732f99cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:15.070847 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-65608453-3c9d-42c7-a209-7ca4840329d4 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] 10.222.0.85 "GET /compute/v2.1/servers/30004414-0945-4eb6-b528-12c871a30aba" status: 200 len: 1314 microversion: 2.1 time: 0.152351 Jun 07 14:48:15.071403 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 426/859] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:48:14 2022] GET /compute/v2.1/servers/30004414-0945-4eb6-b528-12c871a30aba => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:48:15.806156 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-75f9b7ec-fd77-478f-be9a-dfb1f56947b5 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:48:15.806766 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-75f9b7ec-fd77-478f-be9a-dfb1f56947b5 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 46299ff5-499b-4ec8-b2d5-f876e3303a07] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:48:15.814472 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-75f9b7ec-fd77-478f-be9a-dfb1f56947b5 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:15.814904 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-75f9b7ec-fd77-478f-be9a-dfb1f56947b5 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:15.815660 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-75f9b7ec-fd77-478f-be9a-dfb1f56947b5 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:15.816087 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-75f9b7ec-fd77-478f-be9a-dfb1f56947b5 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:15.943344 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-75f9b7ec-fd77-478f-be9a-dfb1f56947b5 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eb9ec1f3ff44bbb03cf934cb2a04de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eae64ee53144e4f8d583bb4288c0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:15.950733 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-75f9b7ec-fd77-478f-be9a-dfb1f56947b5 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/46299ff5-499b-4ec8-b2d5-f876e3303a07" status: 200 len: 1366 microversion: 2.1 time: 0.148423 Jun 07 14:48:15.951288 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 434/860] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:48:15 2022] GET /compute/v2.1/servers/46299ff5-499b-4ec8-b2d5-f876e3303a07 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:48:16.087114 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-1328d423-90eb-4e4b-a620-ef0309669d27 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:48:16.087647 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-1328d423-90eb-4e4b-a620-ef0309669d27 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] [instance: 30004414-0945-4eb6-b528-12c871a30aba] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:48:16.094654 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-1328d423-90eb-4e4b-a620-ef0309669d27 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:16.095205 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-1328d423-90eb-4e4b-a620-ef0309669d27 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:16.095886 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-1328d423-90eb-4e4b-a620-ef0309669d27 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:16.096326 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-1328d423-90eb-4e4b-a620-ef0309669d27 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:16.227761 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-1328d423-90eb-4e4b-a620-ef0309669d27 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2684a7ce412b4124af2155c516b69966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4828df5e016c42bfa253b68f732f99cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:16.235477 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-1328d423-90eb-4e4b-a620-ef0309669d27 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] 10.222.0.85 "GET /compute/v2.1/servers/30004414-0945-4eb6-b528-12c871a30aba" status: 200 len: 1314 microversion: 2.1 time: 0.152332 Jun 07 14:48:16.236074 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 427/861] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:48:16 2022] GET /compute/v2.1/servers/30004414-0945-4eb6-b528-12c871a30aba => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:48:16.967337 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-063a58a4-8853-455d-853e-a0e4e5ecd46d tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:48:16.967947 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-063a58a4-8853-455d-853e-a0e4e5ecd46d tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 46299ff5-499b-4ec8-b2d5-f876e3303a07] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:48:16.973910 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-063a58a4-8853-455d-853e-a0e4e5ecd46d tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:16.974354 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-063a58a4-8853-455d-853e-a0e4e5ecd46d tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:16.975104 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-063a58a4-8853-455d-853e-a0e4e5ecd46d tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:16.975532 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-063a58a4-8853-455d-853e-a0e4e5ecd46d tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:17.106648 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-063a58a4-8853-455d-853e-a0e4e5ecd46d tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eb9ec1f3ff44bbb03cf934cb2a04de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eae64ee53144e4f8d583bb4288c0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:17.114281 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-063a58a4-8853-455d-853e-a0e4e5ecd46d tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/46299ff5-499b-4ec8-b2d5-f876e3303a07" status: 200 len: 1555 microversion: 2.1 time: 0.151038 Jun 07 14:48:17.114828 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 435/862] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:48:16 2022] GET /compute/v2.1/servers/46299ff5-499b-4ec8-b2d5-f876e3303a07 => generated 1555 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:48:17.133210 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-75d43537-7f26-42e1-9a3d-4e09a6e59570 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:48:17.133711 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-75d43537-7f26-42e1-9a3d-4e09a6e59570 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 46299ff5-499b-4ec8-b2d5-f876e3303a07] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:48:17.140175 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-75d43537-7f26-42e1-9a3d-4e09a6e59570 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:17.140658 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-75d43537-7f26-42e1-9a3d-4e09a6e59570 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:17.141437 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-75d43537-7f26-42e1-9a3d-4e09a6e59570 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:17.141877 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-75d43537-7f26-42e1-9a3d-4e09a6e59570 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:17.227016 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-75d43537-7f26-42e1-9a3d-4e09a6e59570 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/46299ff5-499b-4ec8-b2d5-f876e3303a07/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097577 Jun 07 14:48:17.227599 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 428/863] 10.222.0.85 () {58 vars in 1274 bytes} [Tue Jun 7 14:48:17 2022] GET /compute/v2.1/servers/46299ff5-499b-4ec8-b2d5-f876e3303a07/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:48:17.252740 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-aa5ee85d-032d-459f-b668-a660213c29ff tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:48:17.253385 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-aa5ee85d-032d-459f-b668-a660213c29ff tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] [instance: 30004414-0945-4eb6-b528-12c871a30aba] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:48:17.259454 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-aa5ee85d-032d-459f-b668-a660213c29ff tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:17.259944 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-aa5ee85d-032d-459f-b668-a660213c29ff tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:17.260780 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-aa5ee85d-032d-459f-b668-a660213c29ff tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:17.261216 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-aa5ee85d-032d-459f-b668-a660213c29ff tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:17.390561 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-aa5ee85d-032d-459f-b668-a660213c29ff tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2684a7ce412b4124af2155c516b69966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4828df5e016c42bfa253b68f732f99cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:17.399093 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-aa5ee85d-032d-459f-b668-a660213c29ff tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] 10.222.0.85 "GET /compute/v2.1/servers/30004414-0945-4eb6-b528-12c871a30aba" status: 200 len: 1314 microversion: 2.1 time: 0.150099 Jun 07 14:48:17.399683 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 436/864] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:48:17 2022] GET /compute/v2.1/servers/30004414-0945-4eb6-b528-12c871a30aba => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:48:18.368111 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [req-dbc85277-3d53-40e6-9dd8-32f0b2bdc5a0 req-68d9992a-5d33-4c1c-9fcc-dfaa37000d30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30004414-0945-4eb6-b528-12c871a30aba", "name": "network-vif-plugged", "status": "completed", "tag": "24279771-a44a-4f91-a145-80032be76755"}]} {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:48:18.382446 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [req-dbc85277-3d53-40e6-9dd8-32f0b2bdc5a0 req-68d9992a-5d33-4c1c-9fcc-dfaa37000d30 service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:18.382895 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [req-dbc85277-3d53-40e6-9dd8-32f0b2bdc5a0 req-68d9992a-5d33-4c1c-9fcc-dfaa37000d30 service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:18.396399 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.compute.server_external_events [req-dbc85277-3d53-40e6-9dd8-32f0b2bdc5a0 req-68d9992a-5d33-4c1c-9fcc-dfaa37000d30 service nova] Creating event network-vif-plugged:24279771-a44a-4f91-a145-80032be76755 for instance 30004414-0945-4eb6-b528-12c871a30aba on hv-cinder-84497 Jun 07 14:48:18.402080 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [req-dbc85277-3d53-40e6-9dd8-32f0b2bdc5a0 req-68d9992a-5d33-4c1c-9fcc-dfaa37000d30 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038662 Jun 07 14:48:18.405645 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 429/865] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jun 7 14:48:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 14:48:18.416583 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-e9878304-2006-43d4-91b4-912385c2b2d0 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:48:18.417245 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-e9878304-2006-43d4-91b4-912385c2b2d0 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] [instance: 30004414-0945-4eb6-b528-12c871a30aba] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:48:18.434925 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-e9878304-2006-43d4-91b4-912385c2b2d0 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:18.435623 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-e9878304-2006-43d4-91b4-912385c2b2d0 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:18.436457 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-e9878304-2006-43d4-91b4-912385c2b2d0 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:18.436892 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-e9878304-2006-43d4-91b4-912385c2b2d0 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:18.519675 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [req-4fdee7b9-13f7-4cea-8377-9ad4f39f0c4d req-a6f28f90-5d7f-497b-91be-f730a7a72993 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46299ff5-499b-4ec8-b2d5-f876e3303a07", "tag": "67def1cd-fa4f-4a3a-80bf-96a2c73f57b0"}]} {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:48:18.531563 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [req-4fdee7b9-13f7-4cea-8377-9ad4f39f0c4d req-a6f28f90-5d7f-497b-91be-f730a7a72993 service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:18.533030 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [req-4fdee7b9-13f7-4cea-8377-9ad4f39f0c4d req-a6f28f90-5d7f-497b-91be-f730a7a72993 service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:18.552236 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.compute.server_external_events [req-4fdee7b9-13f7-4cea-8377-9ad4f39f0c4d req-a6f28f90-5d7f-497b-91be-f730a7a72993 service nova] Creating event network-changed:67def1cd-fa4f-4a3a-80bf-96a2c73f57b0 for instance 46299ff5-499b-4ec8-b2d5-f876e3303a07 on hv-cinder-84497 Jun 07 14:48:18.557471 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [req-4fdee7b9-13f7-4cea-8377-9ad4f39f0c4d req-a6f28f90-5d7f-497b-91be-f730a7a72993 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041686 Jun 07 14:48:18.558398 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 430/866] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jun 7 14:48:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 14:48:18.673916 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-e9878304-2006-43d4-91b4-912385c2b2d0 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2684a7ce412b4124af2155c516b69966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4828df5e016c42bfa253b68f732f99cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:18.682579 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-e9878304-2006-43d4-91b4-912385c2b2d0 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] 10.222.0.85 "GET /compute/v2.1/servers/30004414-0945-4eb6-b528-12c871a30aba" status: 200 len: 1314 microversion: 2.1 time: 0.269952 Jun 07 14:48:18.683550 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 437/867] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:48:18 2022] GET /compute/v2.1/servers/30004414-0945-4eb6-b528-12c871a30aba => generated 1314 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:48:19.704113 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-846d7083-d949-40c0-89cc-6fd3ab01dfe6 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:48:19.705910 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-846d7083-d949-40c0-89cc-6fd3ab01dfe6 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] [instance: 30004414-0945-4eb6-b528-12c871a30aba] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:48:19.707867 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG dbcounter [-] [118157] Writing DB stats nova_api:SELECT=71,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:48:19.712828 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-846d7083-d949-40c0-89cc-6fd3ab01dfe6 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:19.713290 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-846d7083-d949-40c0-89cc-6fd3ab01dfe6 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:19.714056 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-846d7083-d949-40c0-89cc-6fd3ab01dfe6 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:19.714488 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-846d7083-d949-40c0-89cc-6fd3ab01dfe6 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:19.884479 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-846d7083-d949-40c0-89cc-6fd3ab01dfe6 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2684a7ce412b4124af2155c516b69966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4828df5e016c42bfa253b68f732f99cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:19.896269 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-846d7083-d949-40c0-89cc-6fd3ab01dfe6 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] 10.222.0.85 "GET /compute/v2.1/servers/30004414-0945-4eb6-b528-12c871a30aba" status: 200 len: 1314 microversion: 2.1 time: 0.198421 Jun 07 14:48:19.899874 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 431/868] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:48:19 2022] GET /compute/v2.1/servers/30004414-0945-4eb6-b528-12c871a30aba => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:48:20.691233 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-b6d51641-2781-47ef-a06f-320fb1fc591f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:48:20.691795 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-b6d51641-2781-47ef-a06f-320fb1fc591f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: 89db7091-f026-4913-962e-ad45fd38b468] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:48:20.698427 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-b6d51641-2781-47ef-a06f-320fb1fc591f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:20.698874 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-b6d51641-2781-47ef-a06f-320fb1fc591f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:20.699647 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-b6d51641-2781-47ef-a06f-320fb1fc591f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:20.700692 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-b6d51641-2781-47ef-a06f-320fb1fc591f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:20.726710 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-b6d51641-2781-47ef-a06f-320fb1fc591f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468/ips" status: 200 len: 151 microversion: 2.20 time: 0.039400 Jun 07 14:48:20.727289 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 438/869] 10.222.0.85 () {60 vars in 1288 bytes} [Tue Jun 7 14:48:20 2022] GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468/ips => generated 151 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 14:48:20.916661 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-3eaadbe8-56fb-4837-811e-4dcd4cb18b7e tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:48:20.917395 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-3eaadbe8-56fb-4837-811e-4dcd4cb18b7e tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] [instance: 30004414-0945-4eb6-b528-12c871a30aba] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:48:20.924952 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-3eaadbe8-56fb-4837-811e-4dcd4cb18b7e tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:20.926959 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-3eaadbe8-56fb-4837-811e-4dcd4cb18b7e tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:20.926959 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-3eaadbe8-56fb-4837-811e-4dcd4cb18b7e tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:20.926959 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-3eaadbe8-56fb-4837-811e-4dcd4cb18b7e tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:21.095756 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-3eaadbe8-56fb-4837-811e-4dcd4cb18b7e tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2684a7ce412b4124af2155c516b69966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4828df5e016c42bfa253b68f732f99cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:21.104225 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-3eaadbe8-56fb-4837-811e-4dcd4cb18b7e tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] 10.222.0.85 "GET /compute/v2.1/servers/30004414-0945-4eb6-b528-12c871a30aba" status: 200 len: 1464 microversion: 2.1 time: 0.191658 Jun 07 14:48:21.104813 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 432/870] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:48:20 2022] GET /compute/v2.1/servers/30004414-0945-4eb6-b528-12c871a30aba => generated 1464 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:48:21.146530 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-3624b6f7-d3e0-49e6-a9dd-41f8ce74bad0 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:48:21.147028 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-3624b6f7-d3e0-49e6-a9dd-41f8ce74bad0 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] [instance: 30004414-0945-4eb6-b528-12c871a30aba] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:48:21.154203 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-3624b6f7-d3e0-49e6-a9dd-41f8ce74bad0 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:21.154625 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-3624b6f7-d3e0-49e6-a9dd-41f8ce74bad0 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:21.155494 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-3624b6f7-d3e0-49e6-a9dd-41f8ce74bad0 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:21.155920 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-3624b6f7-d3e0-49e6-a9dd-41f8ce74bad0 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:21.181951 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-3624b6f7-d3e0-49e6-a9dd-41f8ce74bad0 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] [instance: 30004414-0945-4eb6-b528-12c871a30aba] Going to try to terminate instance {{(pid=118158) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 14:48:21.489246 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-3624b6f7-d3e0-49e6-a9dd-41f8ce74bad0 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] 10.222.0.85 "DELETE /compute/v2.1/servers/30004414-0945-4eb6-b528-12c871a30aba" status: 204 len: 0 microversion: 2.1 time: 0.346370 Jun 07 14:48:21.489806 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 439/871] 10.222.0.85 () {58 vars in 1238 bytes} [Tue Jun 7 14:48:21 2022] DELETE /compute/v2.1/servers/30004414-0945-4eb6-b528-12c871a30aba => generated 0 bytes in 348 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 14:48:21.499497 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-6596271d-b018-45bf-9eef-5d0976e69be9 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:48:21.500117 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-6596271d-b018-45bf-9eef-5d0976e69be9 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] [instance: 30004414-0945-4eb6-b528-12c871a30aba] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:48:21.506172 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-6596271d-b018-45bf-9eef-5d0976e69be9 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:21.506625 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-6596271d-b018-45bf-9eef-5d0976e69be9 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:21.507392 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-6596271d-b018-45bf-9eef-5d0976e69be9 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:21.507828 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-6596271d-b018-45bf-9eef-5d0976e69be9 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:21.641177 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-6596271d-b018-45bf-9eef-5d0976e69be9 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2684a7ce412b4124af2155c516b69966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4828df5e016c42bfa253b68f732f99cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:21.649772 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-6596271d-b018-45bf-9eef-5d0976e69be9 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] 10.222.0.85 "GET /compute/v2.1/servers/30004414-0945-4eb6-b528-12c871a30aba" status: 200 len: 1470 microversion: 2.1 time: 0.155780 Jun 07 14:48:21.650328 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 433/872] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:48:21 2022] GET /compute/v2.1/servers/30004414-0945-4eb6-b528-12c871a30aba => generated 1470 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:48:22.668245 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-fd5df74e-e1f6-465b-b9e2-8f2ef768f6b9 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:48:22.668892 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-fd5df74e-e1f6-465b-b9e2-8f2ef768f6b9 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] [instance: 30004414-0945-4eb6-b528-12c871a30aba] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:48:22.675324 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-fd5df74e-e1f6-465b-b9e2-8f2ef768f6b9 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:22.675766 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-fd5df74e-e1f6-465b-b9e2-8f2ef768f6b9 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:22.676553 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-fd5df74e-e1f6-465b-b9e2-8f2ef768f6b9 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:22.676982 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-fd5df74e-e1f6-465b-b9e2-8f2ef768f6b9 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:22.809227 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-fd5df74e-e1f6-465b-b9e2-8f2ef768f6b9 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2684a7ce412b4124af2155c516b69966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4828df5e016c42bfa253b68f732f99cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:22.816759 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-fd5df74e-e1f6-465b-b9e2-8f2ef768f6b9 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] 10.222.0.85 "GET /compute/v2.1/servers/30004414-0945-4eb6-b528-12c871a30aba" status: 200 len: 1470 microversion: 2.1 time: 0.152749 Jun 07 14:48:22.817324 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 440/873] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:48:22 2022] GET /compute/v2.1/servers/30004414-0945-4eb6-b528-12c871a30aba => generated 1470 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:48:23.757549 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [req-bd59c7a4-7259-4010-b23b-c71b39c945fc req-11c7c5a7-4832-45e1-a93d-cac36a036bba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30004414-0945-4eb6-b528-12c871a30aba", "name": "network-vif-deleted", "tag": "24279771-a44a-4f91-a145-80032be76755"}]} {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:48:23.770981 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [req-bd59c7a4-7259-4010-b23b-c71b39c945fc req-11c7c5a7-4832-45e1-a93d-cac36a036bba service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:23.771420 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [req-bd59c7a4-7259-4010-b23b-c71b39c945fc req-11c7c5a7-4832-45e1-a93d-cac36a036bba service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:23.783825 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.compute.server_external_events [req-bd59c7a4-7259-4010-b23b-c71b39c945fc req-11c7c5a7-4832-45e1-a93d-cac36a036bba service nova] Creating event network-vif-deleted:24279771-a44a-4f91-a145-80032be76755 for instance 30004414-0945-4eb6-b528-12c871a30aba on hv-cinder-84497 Jun 07 14:48:23.788979 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [req-bd59c7a4-7259-4010-b23b-c71b39c945fc req-11c7c5a7-4832-45e1-a93d-cac36a036bba service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035054 Jun 07 14:48:23.789612 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 434/874] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jun 7 14:48:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:48:23.833941 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-cd37bcb3-6c2a-44be-99bb-1010cc517f12 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:48:23.835200 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-cd37bcb3-6c2a-44be-99bb-1010cc517f12 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] [instance: 30004414-0945-4eb6-b528-12c871a30aba] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:48:23.841994 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-cd37bcb3-6c2a-44be-99bb-1010cc517f12 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:23.844583 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-cd37bcb3-6c2a-44be-99bb-1010cc517f12 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:23.844583 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-cd37bcb3-6c2a-44be-99bb-1010cc517f12 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:23.844583 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-cd37bcb3-6c2a-44be-99bb-1010cc517f12 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:23.909740 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-cd37bcb3-6c2a-44be-99bb-1010cc517f12 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2684a7ce412b4124af2155c516b69966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4828df5e016c42bfa253b68f732f99cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:23.917211 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-cd37bcb3-6c2a-44be-99bb-1010cc517f12 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] 10.222.0.85 "GET /compute/v2.1/servers/30004414-0945-4eb6-b528-12c871a30aba" status: 200 len: 1428 microversion: 2.1 time: 0.087111 Jun 07 14:48:23.918054 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 441/875] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:48:23 2022] GET /compute/v2.1/servers/30004414-0945-4eb6-b528-12c871a30aba => generated 1428 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:48:24.350117 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-3d9e56b7-33ad-455e-9380-58214111eb1f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:48:24.350746 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-3d9e56b7-33ad-455e-9380-58214111eb1f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: 89db7091-f026-4913-962e-ad45fd38b468] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:48:24.357157 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-3d9e56b7-33ad-455e-9380-58214111eb1f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:24.357621 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-3d9e56b7-33ad-455e-9380-58214111eb1f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:24.358395 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-3d9e56b7-33ad-455e-9380-58214111eb1f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:24.358841 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-3d9e56b7-33ad-455e-9380-58214111eb1f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:24.383170 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.objects.instance [None req-3d9e56b7-33ad-455e-9380-58214111eb1f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lazy-loading 'flavor' on Instance uuid 89db7091-f026-4913-962e-ad45fd38b468 {{(pid=118157) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 14:48:24.933966 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-cf935bfa-69c9-4d50-9815-f2ad008b6372 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:48:24.935107 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-cf935bfa-69c9-4d50-9815-f2ad008b6372 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] [instance: 30004414-0945-4eb6-b528-12c871a30aba] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:48:24.942092 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-cf935bfa-69c9-4d50-9815-f2ad008b6372 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:24.942573 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-cf935bfa-69c9-4d50-9815-f2ad008b6372 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:24.943317 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-cf935bfa-69c9-4d50-9815-f2ad008b6372 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:24.943758 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-cf935bfa-69c9-4d50-9815-f2ad008b6372 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:24.961261 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.wsgi [None req-cf935bfa-69c9-4d50-9815-f2ad008b6372 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] HTTP exception thrown: Instance 30004414-0945-4eb6-b528-12c871a30aba could not be found. Jun 07 14:48:24.963723 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-cf935bfa-69c9-4d50-9815-f2ad008b6372 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Request method failure captured: Jun 07 14:48:24.963723 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: request: GET /compute/v2.1/servers/30004414-0945-4eb6-b528-12c871a30aba HTTP/1.1 Jun 07 14:48:24.963723 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Accept: application/json Jun 07 14:48:24.963723 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Accept-Encoding: identity Jun 07 14:48:24.963723 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Connection: close Jun 07 14:48:24.963723 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Content-Length: 0 Jun 07 14:48:24.963723 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Content-Type: application/json Jun 07 14:48:24.963723 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Host: 10.222.0.85 Jun 07 14:48:24.963723 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Openstack-System-Scope: None Jun 07 14:48:24.963723 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: User-Agent: python-urllib3/1.26.9 Jun 07 14:48:24.963723 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Auth-Token: gAAAAABin2UgXO7VNhtT-0oJKEJVyV-i6b-0qUlxY7SBLZ6qjllh-cp4LkGWJBLn9WZUN9KUQ5BAdAb1BxKvOOaNn-9HSqIktC2TA-g8lY_09pP2yyBdyUZUWmzMbpOnijJ-Fy8KtN1nC2MVJ4jr1KEFLgQQ5E542sdNhjuCZbOPBoTqCVeJjzY Jun 07 14:48:24.963723 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Domain-Id: None Jun 07 14:48:24.963723 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Domain-Name: None Jun 07 14:48:24.963723 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Identity-Status: Confirmed Jun 07 14:48:24.963723 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Is-Admin-Project: True Jun 07 14:48:24.963723 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Domain-Id: default Jun 07 14:48:24.963723 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Domain-Name: Default Jun 07 14:48:24.963723 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Id: 4828df5e016c42bfa253b68f732f99cb Jun 07 14:48:24.963723 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Name: tempest-VolumesNegativeTest-1969970791 Jun 07 14:48:24.963723 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Role: member,reader Jun 07 14:48:24.963723 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Roles: member,reader Jun 07 14:48:24.965460 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/4828df5e016c42bfa253b68f732f99cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_4828df5e016c42bfa253b68f732f99cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/4828df5e016c42bfa253b68f732f99cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/4828df5e016c42bfa253b68f732f99cb"}]}] Jun 07 14:48:24.965460 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Tenant: tempest-VolumesNegativeTest-1969970791 Jun 07 14:48:24.965460 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Tenant-Id: 4828df5e016c42bfa253b68f732f99cb Jun 07 14:48:24.965460 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Tenant-Name: tempest-VolumesNegativeTest-1969970791 Jun 07 14:48:24.965460 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User: tempest-VolumesNegativeTest-1969970791-project Jun 07 14:48:24.965460 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Domain-Id: default Jun 07 14:48:24.965460 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Domain-Name: Default Jun 07 14:48:24.965460 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Id: 2684a7ce412b4124af2155c516b69966 Jun 07 14:48:24.965460 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Name: tempest-VolumesNegativeTest-1969970791-project Jun 07 14:48:24.965460 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: method: > Jun 07 14:48:24.965460 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: exception: Instance 30004414-0945-4eb6-b528-12c871a30aba could not be found. Jun 07 14:48:24.965460 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: action_args: {'id': '30004414-0945-4eb6-b528-12c871a30aba'} Jun 07 14:48:24.966316 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:48:24.966316 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:48:24.966316 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 14:48:24.966316 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 14:48:24.966316 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 14:48:24.966316 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 14:48:24.966316 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 14:48:24.966316 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 14:48:24.966316 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 14:48:24.966316 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 14:48:24.966316 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30004414-0945-4eb6-b528-12c871a30aba could not be found. Jun 07 14:48:24.966316 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:48:24.966316 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:48:24.966316 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:48:24.966316 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:48:24.966316 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:48:24.966316 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:48:24.966316 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:48:24.966316 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:48:24.966316 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:48:24.967604 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:48:24.967604 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 14:48:24.967604 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 14:48:24.967604 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 14:48:24.967604 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 14:48:24.967604 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 14:48:24.967604 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:48:24.967604 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30004414-0945-4eb6-b528-12c871a30aba could not be found. Jun 07 14:48:24.967604 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:48:24.967604 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:48:24.967604 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:48:24.967604 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:48:24.967604 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:48:24.967604 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:48:24.967604 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:48:24.967604 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:48:24.967604 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30004414-0945-4eb6-b528-12c871a30aba could not be found. Jun 07 14:48:24.967604 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:48:24.969079 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-cf935bfa-69c9-4d50-9815-f2ad008b6372 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] Returning 404 to user: Instance 30004414-0945-4eb6-b528-12c871a30aba could not be found. {{(pid=118158) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:48:24.969079 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-cf935bfa-69c9-4d50-9815-f2ad008b6372 tempest-VolumesNegativeTest-1969970791 tempest-VolumesNegativeTest-1969970791-project] 10.222.0.85 "GET /compute/v2.1/servers/30004414-0945-4eb6-b528-12c871a30aba" status: 404 len: 111 microversion: 2.1 time: 0.035204 Jun 07 14:48:24.969079 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 442/876] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:48:24 2022] GET /compute/v2.1/servers/30004414-0945-4eb6-b528-12c871a30aba => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 07 14:48:24.975028 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-3d9e56b7-33ad-455e-9380-58214111eb1f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "POST /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468/action" status: 202 len: 0 microversion: 2.20 time: 0.629020 Jun 07 14:48:24.976082 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 435/877] 10.222.0.85 () {62 vars in 1318 bytes} [Tue Jun 7 14:48:24 2022] POST /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468/action => generated 0 bytes in 631 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 07 14:48:24.984161 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-fb945c27-2ca9-473d-ad99-afef8c44b930 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:48:24.984942 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-fb945c27-2ca9-473d-ad99-afef8c44b930 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: 89db7091-f026-4913-962e-ad45fd38b468] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:48:24.992115 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-fb945c27-2ca9-473d-ad99-afef8c44b930 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:24.992595 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-fb945c27-2ca9-473d-ad99-afef8c44b930 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:24.993369 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-fb945c27-2ca9-473d-ad99-afef8c44b930 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:24.993815 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-fb945c27-2ca9-473d-ad99-afef8c44b930 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:25.127921 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-fb945c27-2ca9-473d-ad99-afef8c44b930 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:25.135563 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-fb945c27-2ca9-473d-ad99-afef8c44b930 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:25.137261 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-fb945c27-2ca9-473d-ad99-afef8c44b930 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:25.138951 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-fb945c27-2ca9-473d-ad99-afef8c44b930 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468" status: 200 len: 1720 microversion: 2.20 time: 0.158736 Jun 07 14:48:25.139509 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 443/878] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:48:24 2022] GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468 => generated 1720 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 14:48:26.159497 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-0d49fc71-9af3-4298-840b-dc7a3060f2f4 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:48:26.160748 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-0d49fc71-9af3-4298-840b-dc7a3060f2f4 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: 89db7091-f026-4913-962e-ad45fd38b468] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:48:26.167190 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-0d49fc71-9af3-4298-840b-dc7a3060f2f4 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:26.167702 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-0d49fc71-9af3-4298-840b-dc7a3060f2f4 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:26.168488 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-0d49fc71-9af3-4298-840b-dc7a3060f2f4 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:26.168923 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-0d49fc71-9af3-4298-840b-dc7a3060f2f4 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:26.302374 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-0d49fc71-9af3-4298-840b-dc7a3060f2f4 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:26.314637 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-0d49fc71-9af3-4298-840b-dc7a3060f2f4 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:26.316223 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-0d49fc71-9af3-4298-840b-dc7a3060f2f4 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:26.317428 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-0d49fc71-9af3-4298-840b-dc7a3060f2f4 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468" status: 200 len: 1720 microversion: 2.20 time: 0.162729 Jun 07 14:48:26.318078 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 436/879] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:48:26 2022] GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468 => generated 1720 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:48:27.336245 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-cf47ee56-3a97-4988-8305-4b50358ef563 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:48:27.336962 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-cf47ee56-3a97-4988-8305-4b50358ef563 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: 89db7091-f026-4913-962e-ad45fd38b468] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:48:27.339449 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG dbcounter [-] [118158] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=118158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:48:27.344405 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-cf47ee56-3a97-4988-8305-4b50358ef563 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:27.347388 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-cf47ee56-3a97-4988-8305-4b50358ef563 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:27.347388 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-cf47ee56-3a97-4988-8305-4b50358ef563 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:27.347388 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-cf47ee56-3a97-4988-8305-4b50358ef563 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:27.488979 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-cf47ee56-3a97-4988-8305-4b50358ef563 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:27.497191 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-cf47ee56-3a97-4988-8305-4b50358ef563 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:27.498685 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-cf47ee56-3a97-4988-8305-4b50358ef563 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:27.500128 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-cf47ee56-3a97-4988-8305-4b50358ef563 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468" status: 200 len: 1720 microversion: 2.20 time: 0.167778 Jun 07 14:48:27.502533 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 444/880] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:48:27 2022] GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468 => generated 1720 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:48:28.520251 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-b97f9fb3-ad60-4d98-b1fa-63379f624497 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:48:28.521023 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-b97f9fb3-ad60-4d98-b1fa-63379f624497 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: 89db7091-f026-4913-962e-ad45fd38b468] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:48:28.527802 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-b97f9fb3-ad60-4d98-b1fa-63379f624497 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:28.528255 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-b97f9fb3-ad60-4d98-b1fa-63379f624497 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:28.529065 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-b97f9fb3-ad60-4d98-b1fa-63379f624497 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:28.529623 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-b97f9fb3-ad60-4d98-b1fa-63379f624497 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:28.664016 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-b97f9fb3-ad60-4d98-b1fa-63379f624497 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:28.674273 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-b97f9fb3-ad60-4d98-b1fa-63379f624497 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:28.675750 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-b97f9fb3-ad60-4d98-b1fa-63379f624497 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:28.676941 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-b97f9fb3-ad60-4d98-b1fa-63379f624497 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468" status: 200 len: 1720 microversion: 2.20 time: 0.162255 Jun 07 14:48:28.677486 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 437/881] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:48:28 2022] GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468 => generated 1720 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:48:29.695334 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-dcd1e58a-2090-4805-afd0-b0a86a7d594f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:48:29.695978 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-dcd1e58a-2090-4805-afd0-b0a86a7d594f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: 89db7091-f026-4913-962e-ad45fd38b468] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:48:29.703135 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-dcd1e58a-2090-4805-afd0-b0a86a7d594f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:29.703621 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-dcd1e58a-2090-4805-afd0-b0a86a7d594f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:29.704401 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-dcd1e58a-2090-4805-afd0-b0a86a7d594f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:29.704829 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-dcd1e58a-2090-4805-afd0-b0a86a7d594f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:29.846018 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-dcd1e58a-2090-4805-afd0-b0a86a7d594f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:29.854006 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-dcd1e58a-2090-4805-afd0-b0a86a7d594f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:29.855503 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-dcd1e58a-2090-4805-afd0-b0a86a7d594f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:29.856756 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-dcd1e58a-2090-4805-afd0-b0a86a7d594f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468" status: 200 len: 1720 microversion: 2.20 time: 0.165386 Jun 07 14:48:29.857303 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 445/882] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:48:29 2022] GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468 => generated 1720 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:48:30.874738 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-7ebe5925-a5e3-4f1d-b483-a690cd6add33 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:48:30.875394 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-7ebe5925-a5e3-4f1d-b483-a690cd6add33 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: 89db7091-f026-4913-962e-ad45fd38b468] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:48:30.881922 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-7ebe5925-a5e3-4f1d-b483-a690cd6add33 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:30.882328 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-7ebe5925-a5e3-4f1d-b483-a690cd6add33 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:30.883152 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-7ebe5925-a5e3-4f1d-b483-a690cd6add33 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:30.883615 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-7ebe5925-a5e3-4f1d-b483-a690cd6add33 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:31.045237 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-7ebe5925-a5e3-4f1d-b483-a690cd6add33 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:31.053651 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-7ebe5925-a5e3-4f1d-b483-a690cd6add33 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:31.055174 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-7ebe5925-a5e3-4f1d-b483-a690cd6add33 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:31.056387 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-7ebe5925-a5e3-4f1d-b483-a690cd6add33 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468" status: 200 len: 1720 microversion: 2.20 time: 0.185592 Jun 07 14:48:31.056951 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 438/883] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:48:30 2022] GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468 => generated 1720 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:48:32.076673 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-5d43d0b9-16dc-4a24-ae3d-1cae3d957209 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:48:32.077599 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-5d43d0b9-16dc-4a24-ae3d-1cae3d957209 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: 89db7091-f026-4913-962e-ad45fd38b468] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:48:32.084349 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5d43d0b9-16dc-4a24-ae3d-1cae3d957209 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:32.084901 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5d43d0b9-16dc-4a24-ae3d-1cae3d957209 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:32.085739 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5d43d0b9-16dc-4a24-ae3d-1cae3d957209 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:32.086241 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5d43d0b9-16dc-4a24-ae3d-1cae3d957209 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:32.231691 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-5d43d0b9-16dc-4a24-ae3d-1cae3d957209 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:32.240397 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-5d43d0b9-16dc-4a24-ae3d-1cae3d957209 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:32.242423 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-5d43d0b9-16dc-4a24-ae3d-1cae3d957209 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:32.247825 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-5d43d0b9-16dc-4a24-ae3d-1cae3d957209 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468" status: 200 len: 1720 microversion: 2.20 time: 0.172179 Jun 07 14:48:32.247825 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 446/884] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:48:32 2022] GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468 => generated 1720 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:48:33.263232 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-0b01ddf3-3c78-4b90-a124-b36008946bd2 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:48:33.263910 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-0b01ddf3-3c78-4b90-a124-b36008946bd2 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: 89db7091-f026-4913-962e-ad45fd38b468] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:48:33.270844 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-0b01ddf3-3c78-4b90-a124-b36008946bd2 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:33.271302 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-0b01ddf3-3c78-4b90-a124-b36008946bd2 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:33.272080 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-0b01ddf3-3c78-4b90-a124-b36008946bd2 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:33.272555 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-0b01ddf3-3c78-4b90-a124-b36008946bd2 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:33.412974 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-0b01ddf3-3c78-4b90-a124-b36008946bd2 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:33.421148 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-0b01ddf3-3c78-4b90-a124-b36008946bd2 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:33.422693 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-0b01ddf3-3c78-4b90-a124-b36008946bd2 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:33.423861 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-0b01ddf3-3c78-4b90-a124-b36008946bd2 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468" status: 200 len: 1720 microversion: 2.20 time: 0.165351 Jun 07 14:48:33.424453 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 439/885] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:48:33 2022] GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468 => generated 1720 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:48:34.446341 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-e2b41f24-2427-4df6-ae54-d526952b1a07 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:48:34.448431 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-e2b41f24-2427-4df6-ae54-d526952b1a07 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: 89db7091-f026-4913-962e-ad45fd38b468] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:48:34.457744 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-e2b41f24-2427-4df6-ae54-d526952b1a07 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:34.458240 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-e2b41f24-2427-4df6-ae54-d526952b1a07 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:34.459005 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-e2b41f24-2427-4df6-ae54-d526952b1a07 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:34.459444 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-e2b41f24-2427-4df6-ae54-d526952b1a07 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:34.657693 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-e2b41f24-2427-4df6-ae54-d526952b1a07 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:34.666698 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-e2b41f24-2427-4df6-ae54-d526952b1a07 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:34.668472 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-e2b41f24-2427-4df6-ae54-d526952b1a07 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:34.669749 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-e2b41f24-2427-4df6-ae54-d526952b1a07 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468" status: 200 len: 1720 microversion: 2.20 time: 0.230926 Jun 07 14:48:34.670420 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 447/886] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:48:34 2022] GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468 => generated 1720 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 14:48:35.688873 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-32e33b70-6e83-4d9b-a113-5a214769e47f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:48:35.690419 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-32e33b70-6e83-4d9b-a113-5a214769e47f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: 89db7091-f026-4913-962e-ad45fd38b468] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:48:35.697173 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-32e33b70-6e83-4d9b-a113-5a214769e47f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:35.697971 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-32e33b70-6e83-4d9b-a113-5a214769e47f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:35.698971 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-32e33b70-6e83-4d9b-a113-5a214769e47f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:35.700356 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-32e33b70-6e83-4d9b-a113-5a214769e47f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:35.852488 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-32e33b70-6e83-4d9b-a113-5a214769e47f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:35.861252 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-32e33b70-6e83-4d9b-a113-5a214769e47f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:35.862760 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-32e33b70-6e83-4d9b-a113-5a214769e47f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:35.863939 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-32e33b70-6e83-4d9b-a113-5a214769e47f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468" status: 200 len: 1720 microversion: 2.20 time: 0.179784 Jun 07 14:48:35.865231 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 440/887] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:48:35 2022] GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468 => generated 1720 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:48:36.882709 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-3266cdbe-19af-40cc-a907-fc4b7c3e2d7d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:48:36.883342 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-3266cdbe-19af-40cc-a907-fc4b7c3e2d7d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: 89db7091-f026-4913-962e-ad45fd38b468] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:48:36.891797 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-3266cdbe-19af-40cc-a907-fc4b7c3e2d7d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:36.892206 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-3266cdbe-19af-40cc-a907-fc4b7c3e2d7d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:36.893093 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-3266cdbe-19af-40cc-a907-fc4b7c3e2d7d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:36.893734 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-3266cdbe-19af-40cc-a907-fc4b7c3e2d7d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:37.134566 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-3266cdbe-19af-40cc-a907-fc4b7c3e2d7d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:37.141961 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-3266cdbe-19af-40cc-a907-fc4b7c3e2d7d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:37.143870 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-3266cdbe-19af-40cc-a907-fc4b7c3e2d7d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:37.144990 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-3266cdbe-19af-40cc-a907-fc4b7c3e2d7d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468" status: 200 len: 1720 microversion: 2.20 time: 0.266438 Jun 07 14:48:37.145541 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 448/888] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:48:36 2022] GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468 => generated 1720 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:48:38.163112 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-a3624376-cc6a-4d07-906b-708915c4d696 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:48:38.163648 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-a3624376-cc6a-4d07-906b-708915c4d696 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: 89db7091-f026-4913-962e-ad45fd38b468] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:48:38.176003 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-a3624376-cc6a-4d07-906b-708915c4d696 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:38.176751 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-a3624376-cc6a-4d07-906b-708915c4d696 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:38.177823 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-a3624376-cc6a-4d07-906b-708915c4d696 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:38.178425 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-a3624376-cc6a-4d07-906b-708915c4d696 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:38.195586 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG dbcounter [-] [118157] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:48:38.362390 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-a3624376-cc6a-4d07-906b-708915c4d696 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:38.371022 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-a3624376-cc6a-4d07-906b-708915c4d696 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:38.376177 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-a3624376-cc6a-4d07-906b-708915c4d696 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:38.377804 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-a3624376-cc6a-4d07-906b-708915c4d696 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468" status: 200 len: 1720 microversion: 2.20 time: 0.218637 Jun 07 14:48:38.379475 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 441/889] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:48:38 2022] GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468 => generated 1720 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:48:39.397055 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-9a187241-64c8-4b95-b868-77bb0b1e523f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:48:39.397963 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-9a187241-64c8-4b95-b868-77bb0b1e523f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: 89db7091-f026-4913-962e-ad45fd38b468] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:48:39.405188 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-9a187241-64c8-4b95-b868-77bb0b1e523f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:39.405629 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-9a187241-64c8-4b95-b868-77bb0b1e523f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:39.406397 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-9a187241-64c8-4b95-b868-77bb0b1e523f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:39.406823 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-9a187241-64c8-4b95-b868-77bb0b1e523f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:39.627097 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-9a187241-64c8-4b95-b868-77bb0b1e523f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:39.629945 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG dbcounter [-] [118158] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:48:39.636780 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-9a187241-64c8-4b95-b868-77bb0b1e523f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:39.639120 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-9a187241-64c8-4b95-b868-77bb0b1e523f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:39.640572 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-9a187241-64c8-4b95-b868-77bb0b1e523f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468" status: 200 len: 1720 microversion: 2.20 time: 0.247525 Jun 07 14:48:39.641286 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 449/890] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:48:39 2022] GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468 => generated 1720 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:48:40.661246 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-64b3ae5a-918c-4c10-844b-e9e70a0e6164 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:48:40.662487 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-64b3ae5a-918c-4c10-844b-e9e70a0e6164 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: 89db7091-f026-4913-962e-ad45fd38b468] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:48:40.670799 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-64b3ae5a-918c-4c10-844b-e9e70a0e6164 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:40.671620 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-64b3ae5a-918c-4c10-844b-e9e70a0e6164 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:40.672716 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-64b3ae5a-918c-4c10-844b-e9e70a0e6164 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:40.673258 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-64b3ae5a-918c-4c10-844b-e9e70a0e6164 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:40.953676 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-64b3ae5a-918c-4c10-844b-e9e70a0e6164 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:40.970556 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-64b3ae5a-918c-4c10-844b-e9e70a0e6164 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:40.973143 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-64b3ae5a-918c-4c10-844b-e9e70a0e6164 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:40.974656 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-64b3ae5a-918c-4c10-844b-e9e70a0e6164 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468" status: 200 len: 1720 microversion: 2.20 time: 0.318403 Jun 07 14:48:40.981420 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 442/891] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:48:40 2022] GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468 => generated 1720 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:48:42.001970 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-d1c80254-5502-4d21-a448-e0580eb7f15b tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:48:42.002730 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-d1c80254-5502-4d21-a448-e0580eb7f15b tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: 89db7091-f026-4913-962e-ad45fd38b468] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:48:42.013515 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-d1c80254-5502-4d21-a448-e0580eb7f15b tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:42.014192 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-d1c80254-5502-4d21-a448-e0580eb7f15b tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:42.023371 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-d1c80254-5502-4d21-a448-e0580eb7f15b tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:42.023371 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-d1c80254-5502-4d21-a448-e0580eb7f15b tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:42.218396 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-d1c80254-5502-4d21-a448-e0580eb7f15b tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:42.230064 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-d1c80254-5502-4d21-a448-e0580eb7f15b tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:42.237803 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-d1c80254-5502-4d21-a448-e0580eb7f15b tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:42.237803 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-d1c80254-5502-4d21-a448-e0580eb7f15b tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468" status: 200 len: 1741 microversion: 2.20 time: 0.238377 Jun 07 14:48:42.237803 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 450/892] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:48:41 2022] GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468 => generated 1741 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:48:43.256286 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-e5a47b77-7319-4059-97b4-cceff773063e tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:48:43.257159 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-e5a47b77-7319-4059-97b4-cceff773063e tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: 89db7091-f026-4913-962e-ad45fd38b468] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:48:43.275564 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-e5a47b77-7319-4059-97b4-cceff773063e tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:43.276289 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-e5a47b77-7319-4059-97b4-cceff773063e tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:43.277322 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-e5a47b77-7319-4059-97b4-cceff773063e tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:43.278032 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-e5a47b77-7319-4059-97b4-cceff773063e tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:43.775386 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-e5a47b77-7319-4059-97b4-cceff773063e tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:43.783906 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-e5a47b77-7319-4059-97b4-cceff773063e tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:43.785533 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-e5a47b77-7319-4059-97b4-cceff773063e tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:43.786705 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-e5a47b77-7319-4059-97b4-cceff773063e tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468" status: 200 len: 1741 microversion: 2.20 time: 0.534397 Jun 07 14:48:43.787559 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 443/893] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:48:43 2022] GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468 => generated 1741 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 14:48:44.806891 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-5306988c-cede-4cfe-8ca3-4c8531001d9e tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:48:44.807575 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-5306988c-cede-4cfe-8ca3-4c8531001d9e tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: 89db7091-f026-4913-962e-ad45fd38b468] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:48:44.822355 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5306988c-cede-4cfe-8ca3-4c8531001d9e tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:44.828660 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5306988c-cede-4cfe-8ca3-4c8531001d9e tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:44.828660 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5306988c-cede-4cfe-8ca3-4c8531001d9e tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:44.829123 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5306988c-cede-4cfe-8ca3-4c8531001d9e tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:45.014349 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-5306988c-cede-4cfe-8ca3-4c8531001d9e tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:45.029260 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-5306988c-cede-4cfe-8ca3-4c8531001d9e tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:45.030950 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-5306988c-cede-4cfe-8ca3-4c8531001d9e tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:45.035488 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-5306988c-cede-4cfe-8ca3-4c8531001d9e tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468" status: 200 len: 1741 microversion: 2.20 time: 0.230720 Jun 07 14:48:45.035488 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 451/894] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:48:44 2022] GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468 => generated 1741 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:48:46.055110 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-b81498ac-db87-4a67-a221-e1ccd8f5346f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:48:46.059694 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-b81498ac-db87-4a67-a221-e1ccd8f5346f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: 89db7091-f026-4913-962e-ad45fd38b468] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:48:46.075814 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-b81498ac-db87-4a67-a221-e1ccd8f5346f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:46.076448 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-b81498ac-db87-4a67-a221-e1ccd8f5346f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:46.077405 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-b81498ac-db87-4a67-a221-e1ccd8f5346f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:46.080946 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-b81498ac-db87-4a67-a221-e1ccd8f5346f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:46.259309 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-b81498ac-db87-4a67-a221-e1ccd8f5346f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:46.269427 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-b81498ac-db87-4a67-a221-e1ccd8f5346f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:46.277149 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-b81498ac-db87-4a67-a221-e1ccd8f5346f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:46.279764 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-b81498ac-db87-4a67-a221-e1ccd8f5346f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468" status: 200 len: 1741 microversion: 2.20 time: 0.227709 Jun 07 14:48:46.281392 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 444/895] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:48:46 2022] GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468 => generated 1741 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:48:46.825821 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [req-53b04748-609b-48d0-80e6-f5cff17ce542 req-16203f51-eefe-4847-af8f-eb1675465c1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89db7091-f026-4913-962e-ad45fd38b468", "name": "network-vif-plugged", "status": "completed", "tag": "cf25b5fc-6d60-40d5-8461-593838e20baf"}]} {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:48:46.842036 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [req-53b04748-609b-48d0-80e6-f5cff17ce542 req-16203f51-eefe-4847-af8f-eb1675465c1d service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:46.843485 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [req-53b04748-609b-48d0-80e6-f5cff17ce542 req-16203f51-eefe-4847-af8f-eb1675465c1d service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:46.862650 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.compute.server_external_events [req-53b04748-609b-48d0-80e6-f5cff17ce542 req-16203f51-eefe-4847-af8f-eb1675465c1d service nova] Creating event network-vif-plugged:cf25b5fc-6d60-40d5-8461-593838e20baf for instance 89db7091-f026-4913-962e-ad45fd38b468 on hv-cinder-84497 Jun 07 14:48:46.869296 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [req-53b04748-609b-48d0-80e6-f5cff17ce542 req-16203f51-eefe-4847-af8f-eb1675465c1d service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047238 Jun 07 14:48:46.870305 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 452/896] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jun 7 14:48:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 14:48:47.300174 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-c4c7d592-d5e5-467b-9460-da6615fe92a4 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:48:47.301504 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-c4c7d592-d5e5-467b-9460-da6615fe92a4 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: 89db7091-f026-4913-962e-ad45fd38b468] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:48:47.310052 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-c4c7d592-d5e5-467b-9460-da6615fe92a4 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:47.310943 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-c4c7d592-d5e5-467b-9460-da6615fe92a4 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:47.311798 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-c4c7d592-d5e5-467b-9460-da6615fe92a4 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:47.312467 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-c4c7d592-d5e5-467b-9460-da6615fe92a4 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:47.572198 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-c4c7d592-d5e5-467b-9460-da6615fe92a4 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:47.581892 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-c4c7d592-d5e5-467b-9460-da6615fe92a4 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:47.584548 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-c4c7d592-d5e5-467b-9460-da6615fe92a4 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:47.587524 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-c4c7d592-d5e5-467b-9460-da6615fe92a4 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468" status: 200 len: 1736 microversion: 2.20 time: 0.290462 Jun 07 14:48:47.589765 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 445/897] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:48:47 2022] GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468 => generated 1736 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:48:48.608258 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-42003a60-260c-4877-82bc-bdd0a897f40a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:48:48.609016 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-42003a60-260c-4877-82bc-bdd0a897f40a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: 89db7091-f026-4913-962e-ad45fd38b468] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:48:48.628059 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-42003a60-260c-4877-82bc-bdd0a897f40a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:48.632931 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-42003a60-260c-4877-82bc-bdd0a897f40a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:48.634032 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-42003a60-260c-4877-82bc-bdd0a897f40a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:48.634649 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-42003a60-260c-4877-82bc-bdd0a897f40a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:48.919878 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-42003a60-260c-4877-82bc-bdd0a897f40a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:48.930174 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-42003a60-260c-4877-82bc-bdd0a897f40a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:48.932018 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-42003a60-260c-4877-82bc-bdd0a897f40a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:48.934212 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-42003a60-260c-4877-82bc-bdd0a897f40a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468" status: 200 len: 1736 microversion: 2.20 time: 0.330771 Jun 07 14:48:48.944349 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 453/898] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:48:48 2022] GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468 => generated 1736 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:48:49.280209 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-adeb1ddc-7264-4f97-966f-9a848be580b8 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:48:49.281351 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-adeb1ddc-7264-4f97-966f-9a848be580b8 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e038fb54-192d-4af5-a273-955b1493d4b4] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:48:49.289390 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-adeb1ddc-7264-4f97-966f-9a848be580b8 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:49.290153 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-adeb1ddc-7264-4f97-966f-9a848be580b8 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:49.291280 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-adeb1ddc-7264-4f97-966f-9a848be580b8 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:49.291892 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-adeb1ddc-7264-4f97-966f-9a848be580b8 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:49.330435 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-adeb1ddc-7264-4f97-966f-9a848be580b8 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e038fb54-192d-4af5-a273-955b1493d4b4/ips" status: 200 len: 146 microversion: 2.1 time: 0.060975 Jun 07 14:48:49.331390 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 446/899] 10.222.0.85 () {58 vars in 1247 bytes} [Tue Jun 7 14:48:49 2022] GET /compute/v2.1/servers/e038fb54-192d-4af5-a273-955b1493d4b4/ips => generated 146 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:48:49.962226 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-eaab4e18-2f52-429b-80b6-c00f07899785 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:48:49.963442 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-eaab4e18-2f52-429b-80b6-c00f07899785 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: 89db7091-f026-4913-962e-ad45fd38b468] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:48:49.976089 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-eaab4e18-2f52-429b-80b6-c00f07899785 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:49.981389 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-eaab4e18-2f52-429b-80b6-c00f07899785 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:49.981389 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-eaab4e18-2f52-429b-80b6-c00f07899785 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:49.981389 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-eaab4e18-2f52-429b-80b6-c00f07899785 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:50.343268 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-eaab4e18-2f52-429b-80b6-c00f07899785 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:50.352592 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-eaab4e18-2f52-429b-80b6-c00f07899785 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:50.363442 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-eaab4e18-2f52-429b-80b6-c00f07899785 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:50.365276 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-eaab4e18-2f52-429b-80b6-c00f07899785 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468" status: 200 len: 1736 microversion: 2.20 time: 0.415435 Jun 07 14:48:50.371224 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 454/900] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:48:49 2022] GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468 => generated 1736 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:48:51.385350 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-69d63121-4619-426a-9ad0-df50041c4fa3 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:48:51.385957 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-69d63121-4619-426a-9ad0-df50041c4fa3 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: 89db7091-f026-4913-962e-ad45fd38b468] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:48:51.392582 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG dbcounter [-] [118157] Writing DB stats nova_api:SELECT=32 {{(pid=118157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:48:51.394506 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-69d63121-4619-426a-9ad0-df50041c4fa3 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:51.395127 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-69d63121-4619-426a-9ad0-df50041c4fa3 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:51.396034 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-69d63121-4619-426a-9ad0-df50041c4fa3 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:51.396642 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-69d63121-4619-426a-9ad0-df50041c4fa3 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:51.609620 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-69d63121-4619-426a-9ad0-df50041c4fa3 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:51.620408 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-69d63121-4619-426a-9ad0-df50041c4fa3 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:51.622513 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-69d63121-4619-426a-9ad0-df50041c4fa3 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:51.623715 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-69d63121-4619-426a-9ad0-df50041c4fa3 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468" status: 200 len: 1736 microversion: 2.20 time: 0.242220 Jun 07 14:48:51.624597 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 447/901] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:48:51 2022] GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468 => generated 1736 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:48:52.466651 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-5d6248b8-f0f3-4eb1-9a84-d7421c996644 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d005f9f8-ff50-4e2b-8940-0a4b2d313083"}} {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:48:52.468555 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-5d6248b8-f0f3-4eb1-9a84-d7421c996644 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e038fb54-192d-4af5-a273-955b1493d4b4] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:48:52.476214 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5d6248b8-f0f3-4eb1-9a84-d7421c996644 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:52.476998 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5d6248b8-f0f3-4eb1-9a84-d7421c996644 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:52.478002 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5d6248b8-f0f3-4eb1-9a84-d7421c996644 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:52.478674 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5d6248b8-f0f3-4eb1-9a84-d7421c996644 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:52.642960 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-4c64790f-147c-48f6-bcf5-961765d8cc0a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:48:52.644182 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-4c64790f-147c-48f6-bcf5-961765d8cc0a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: 89db7091-f026-4913-962e-ad45fd38b468] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:48:52.658839 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-4c64790f-147c-48f6-bcf5-961765d8cc0a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:52.659565 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-4c64790f-147c-48f6-bcf5-961765d8cc0a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:52.660554 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-4c64790f-147c-48f6-bcf5-961765d8cc0a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:52.661395 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-4c64790f-147c-48f6-bcf5-961765d8cc0a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:52.895420 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-4c64790f-147c-48f6-bcf5-961765d8cc0a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:52.907611 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-4c64790f-147c-48f6-bcf5-961765d8cc0a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:52.912402 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-4c64790f-147c-48f6-bcf5-961765d8cc0a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:52.913962 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-4c64790f-147c-48f6-bcf5-961765d8cc0a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468" status: 200 len: 1736 microversion: 2.20 time: 0.275333 Jun 07 14:48:52.927914 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 448/902] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:48:52 2022] GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468 => generated 1736 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:48:53.746857 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-5d6248b8-f0f3-4eb1-9a84-d7421c996644 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "POST /compute/v2.1/servers/e038fb54-192d-4af5-a273-955b1493d4b4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.283873 Jun 07 14:48:53.747538 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 455/903] 10.222.0.85 () {60 vars in 1322 bytes} [Tue Jun 7 14:48:52 2022] POST /compute/v2.1/servers/e038fb54-192d-4af5-a273-955b1493d4b4/os-volume_attachments => generated 194 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 14:48:53.934645 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-d18a64fb-396a-4d1a-a527-47f0f9cf6da6 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:48:53.935483 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-d18a64fb-396a-4d1a-a527-47f0f9cf6da6 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: 89db7091-f026-4913-962e-ad45fd38b468] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:48:53.942694 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-d18a64fb-396a-4d1a-a527-47f0f9cf6da6 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:53.942848 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-d18a64fb-396a-4d1a-a527-47f0f9cf6da6 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:53.943583 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-d18a64fb-396a-4d1a-a527-47f0f9cf6da6 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:53.947288 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-d18a64fb-396a-4d1a-a527-47f0f9cf6da6 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:54.204508 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-d18a64fb-396a-4d1a-a527-47f0f9cf6da6 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:54.213828 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-d18a64fb-396a-4d1a-a527-47f0f9cf6da6 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:54.216542 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-d18a64fb-396a-4d1a-a527-47f0f9cf6da6 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:54.217991 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-d18a64fb-396a-4d1a-a527-47f0f9cf6da6 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468" status: 200 len: 1736 microversion: 2.20 time: 0.288100 Jun 07 14:48:54.218728 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 449/904] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:48:53 2022] GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468 => generated 1736 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:48:55.237295 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-6f682da3-cb5b-43b5-9b05-69c757bc0d73 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:48:55.238661 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-6f682da3-cb5b-43b5-9b05-69c757bc0d73 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: 89db7091-f026-4913-962e-ad45fd38b468] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:48:55.248936 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-6f682da3-cb5b-43b5-9b05-69c757bc0d73 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:55.249693 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-6f682da3-cb5b-43b5-9b05-69c757bc0d73 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:55.250632 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-6f682da3-cb5b-43b5-9b05-69c757bc0d73 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:55.251312 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-6f682da3-cb5b-43b5-9b05-69c757bc0d73 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:55.428604 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-6f682da3-cb5b-43b5-9b05-69c757bc0d73 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:55.438087 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-6f682da3-cb5b-43b5-9b05-69c757bc0d73 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:55.439588 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-6f682da3-cb5b-43b5-9b05-69c757bc0d73 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:55.449424 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-6f682da3-cb5b-43b5-9b05-69c757bc0d73 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468" status: 200 len: 1736 microversion: 2.20 time: 0.216976 Jun 07 14:48:55.450222 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 456/905] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:48:55 2022] GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468 => generated 1736 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:48:56.468199 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-50b0f94d-c6d1-4235-8619-f33aea75049d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:48:56.476553 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-50b0f94d-c6d1-4235-8619-f33aea75049d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: 89db7091-f026-4913-962e-ad45fd38b468] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:48:56.484971 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-50b0f94d-c6d1-4235-8619-f33aea75049d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:56.485764 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-50b0f94d-c6d1-4235-8619-f33aea75049d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:56.487066 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-50b0f94d-c6d1-4235-8619-f33aea75049d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:56.487627 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-50b0f94d-c6d1-4235-8619-f33aea75049d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:56.649486 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-50b0f94d-c6d1-4235-8619-f33aea75049d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:56.658605 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-50b0f94d-c6d1-4235-8619-f33aea75049d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:56.660440 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-50b0f94d-c6d1-4235-8619-f33aea75049d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:56.661812 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-50b0f94d-c6d1-4235-8619-f33aea75049d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468" status: 200 len: 1736 microversion: 2.20 time: 0.197727 Jun 07 14:48:56.662375 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 450/906] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:48:56 2022] GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468 => generated 1736 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:48:57.682394 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-6e737397-578a-462f-b05a-775b8bc01c1d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:48:57.683187 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-6e737397-578a-462f-b05a-775b8bc01c1d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: 89db7091-f026-4913-962e-ad45fd38b468] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:48:57.685836 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG dbcounter [-] [118158] Writing DB stats nova_api:SELECT=26 {{(pid=118158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:48:57.691386 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-6e737397-578a-462f-b05a-775b8bc01c1d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:57.692324 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-6e737397-578a-462f-b05a-775b8bc01c1d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:57.694581 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-6e737397-578a-462f-b05a-775b8bc01c1d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:57.695270 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-6e737397-578a-462f-b05a-775b8bc01c1d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:57.765374 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-201238d1-6bfb-4a6e-b2dd-97c9b585e48f tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Action: 'create', calling method: .version_select at 0x7f5f88100670>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1270995629", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMEoUcwvXQ7wDM5cBjEMRpR1I/did5JzrXAWVbdwg845V4VvOh4XIAbwE+sSEi8x+Lz2vHuU0cae3xZpil+8XPn1/0LShjis0fal4TNqKA5JfZXFC+v720zJkHt8C6HKCg=="}} {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:48:57.782999 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.quota [None req-201238d1-6bfb-4a6e-b2dd-97c9b585e48f tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Getting quotas for project 70b63567b3e54cf1a4348fb65b65a040. Resources: {'key_pairs'} {{(pid=118157) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 14:48:57.787475 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.quota [None req-201238d1-6bfb-4a6e-b2dd-97c9b585e48f tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Getting quotas for user f2b3f5c080034b658cbfb311c0c77b26 and project 70b63567b3e54cf1a4348fb65b65a040. Resources: {'key_pairs'} {{(pid=118157) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 14:48:57.855612 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-6e737397-578a-462f-b05a-775b8bc01c1d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:57.864487 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-6e737397-578a-462f-b05a-775b8bc01c1d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:57.865979 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-6e737397-578a-462f-b05a-775b8bc01c1d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:57.867346 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-6e737397-578a-462f-b05a-775b8bc01c1d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468" status: 200 len: 1736 microversion: 2.20 time: 0.190072 Jun 07 14:48:57.879094 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 457/907] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:48:57 2022] GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468 => generated 1736 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:48:57.913856 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-201238d1-6bfb-4a6e-b2dd-97c9b585e48f tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.152440 Jun 07 14:48:57.915136 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 451/908] 10.222.0.85 () {60 vars in 1158 bytes} [Tue Jun 7 14:48:57 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 14:48:57.980125 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-64c9cd36-bfc1-499b-8dff-a9eb895a7f42 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2094253302", "imageRef": "06e33de2-e016-48fa-9ffe-166b8dcd94c8", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1270995629", "networks": [{"uuid": "d30632f3-b65f-4fde-ba50-fa6b6913b74b"}]}} {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:48:58.033976 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.network.neutron [None req-64c9cd36-bfc1-499b-8dff-a9eb895a7f42 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] validate_networks() for [('d30632f3-b65f-4fde-ba50-fa6b6913b74b', None, None, None, None, None)] {{(pid=118158) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 14:48:58.455347 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.virt.hardware [None req-64c9cd36-bfc1-499b-8dff-a9eb895a7f42 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Flavor limits 0:0:0 {{(pid=118158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 14:48:58.455769 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.virt.hardware [None req-64c9cd36-bfc1-499b-8dff-a9eb895a7f42 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Image limits 0:0:0 {{(pid=118158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 14:48:58.456257 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.virt.hardware [None req-64c9cd36-bfc1-499b-8dff-a9eb895a7f42 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Flavor pref 0:0:0 {{(pid=118158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 14:48:58.456670 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.virt.hardware [None req-64c9cd36-bfc1-499b-8dff-a9eb895a7f42 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Image pref 0:0:0 {{(pid=118158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 14:48:58.457078 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.virt.hardware [None req-64c9cd36-bfc1-499b-8dff-a9eb895a7f42 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118158) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 14:48:58.472706 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-64c9cd36-bfc1-499b-8dff-a9eb895a7f42 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:58.473885 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-64c9cd36-bfc1-499b-8dff-a9eb895a7f42 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:58.474038 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-64c9cd36-bfc1-499b-8dff-a9eb895a7f42 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:58.474364 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-64c9cd36-bfc1-499b-8dff-a9eb895a7f42 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:58.493101 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.quota [None req-64c9cd36-bfc1-499b-8dff-a9eb895a7f42 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Getting quotas for project 70b63567b3e54cf1a4348fb65b65a040. Resources: {'instances', 'cores', 'ram'} {{(pid=118158) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 14:48:58.497957 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.quota [None req-64c9cd36-bfc1-499b-8dff-a9eb895a7f42 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Getting quotas for user f2b3f5c080034b658cbfb311c0c77b26 and project 70b63567b3e54cf1a4348fb65b65a040. Resources: {'instances', 'cores', 'ram'} {{(pid=118158) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 14:48:58.509678 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-64c9cd36-bfc1-499b-8dff-a9eb895a7f42 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Going to run 1 instances... {{(pid=118158) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 14:48:58.518334 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-64c9cd36-bfc1-499b-8dff-a9eb895a7f42 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] [instance: 75e38ceb-ae6e-456f-968b-90e5f4f39d37] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='06e33de2-e016-48fa-9ffe-166b8dcd94c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118158) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 14:48:58.845909 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-64c9cd36-bfc1-499b-8dff-a9eb895a7f42 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.869547 Jun 07 14:48:58.846855 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 458/909] 10.222.0.85 () {60 vars in 1146 bytes} [Tue Jun 7 14:48:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 871 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 14:48:58.857356 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-5058a776-d6d3-415a-83ab-6172c11a4174 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:48:58.857994 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-5058a776-d6d3-415a-83ab-6172c11a4174 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] [instance: 75e38ceb-ae6e-456f-968b-90e5f4f39d37] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:48:58.887886 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-8f23d1da-0391-46eb-b481-c01e7c3bbb4a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:48:58.889670 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-8f23d1da-0391-46eb-b481-c01e7c3bbb4a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: 89db7091-f026-4913-962e-ad45fd38b468] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:48:58.897478 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-8f23d1da-0391-46eb-b481-c01e7c3bbb4a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:58.898802 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-8f23d1da-0391-46eb-b481-c01e7c3bbb4a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:58.901072 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-8f23d1da-0391-46eb-b481-c01e7c3bbb4a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:48:58.902891 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-8f23d1da-0391-46eb-b481-c01e7c3bbb4a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:48:58.981343 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-5058a776-d6d3-415a-83ab-6172c11a4174 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b3f5c080034b658cbfb311c0c77b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b63567b3e54cf1a4348fb65b65a040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:58.990061 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-5058a776-d6d3-415a-83ab-6172c11a4174 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] 10.222.0.85 "GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37" status: 200 len: 1259 microversion: 2.1 time: 0.137390 Jun 07 14:48:58.990954 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 452/910] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:48:58 2022] GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37 => generated 1259 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:48:59.107435 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-8f23d1da-0391-46eb-b481-c01e7c3bbb4a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:59.121971 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-8f23d1da-0391-46eb-b481-c01e7c3bbb4a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:59.126186 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-8f23d1da-0391-46eb-b481-c01e7c3bbb4a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:48:59.126186 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-8f23d1da-0391-46eb-b481-c01e7c3bbb4a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468" status: 200 len: 1736 microversion: 2.20 time: 0.242631 Jun 07 14:48:59.126615 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 459/911] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:48:58 2022] GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468 => generated 1736 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 14:49:00.007721 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-de543784-1bce-4350-9bfe-1ab7771d04c2 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:00.008463 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-de543784-1bce-4350-9bfe-1ab7771d04c2 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] [instance: 75e38ceb-ae6e-456f-968b-90e5f4f39d37] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:00.077915 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-de543784-1bce-4350-9bfe-1ab7771d04c2 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b3f5c080034b658cbfb311c0c77b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b63567b3e54cf1a4348fb65b65a040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:00.086181 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-de543784-1bce-4350-9bfe-1ab7771d04c2 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] 10.222.0.85 "GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37" status: 200 len: 1259 microversion: 2.1 time: 0.082103 Jun 07 14:49:00.087334 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 453/912] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:49:00 2022] GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37 => generated 1259 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:49:00.143944 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-aa9ebf6a-0d38-431f-b79a-156d7817d073 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:00.144565 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-aa9ebf6a-0d38-431f-b79a-156d7817d073 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: 89db7091-f026-4913-962e-ad45fd38b468] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:00.151702 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-aa9ebf6a-0d38-431f-b79a-156d7817d073 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:00.152155 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-aa9ebf6a-0d38-431f-b79a-156d7817d073 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:00.153493 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-aa9ebf6a-0d38-431f-b79a-156d7817d073 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:00.153979 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-aa9ebf6a-0d38-431f-b79a-156d7817d073 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:00.302605 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-aa9ebf6a-0d38-431f-b79a-156d7817d073 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:00.311207 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-aa9ebf6a-0d38-431f-b79a-156d7817d073 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:00.312753 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-aa9ebf6a-0d38-431f-b79a-156d7817d073 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:00.313918 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-aa9ebf6a-0d38-431f-b79a-156d7817d073 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468" status: 200 len: 1736 microversion: 2.20 time: 0.174138 Jun 07 14:49:00.314521 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 460/913] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:49:00 2022] GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468 => generated 1736 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:49:01.107622 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-f82fd3a0-0f84-4efd-8366-7427189bc1f0 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:01.108233 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-f82fd3a0-0f84-4efd-8366-7427189bc1f0 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] [instance: 75e38ceb-ae6e-456f-968b-90e5f4f39d37] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:01.115442 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-f82fd3a0-0f84-4efd-8366-7427189bc1f0 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:01.115881 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-f82fd3a0-0f84-4efd-8366-7427189bc1f0 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:01.116684 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-f82fd3a0-0f84-4efd-8366-7427189bc1f0 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:01.117114 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-f82fd3a0-0f84-4efd-8366-7427189bc1f0 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:01.179291 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-f82fd3a0-0f84-4efd-8366-7427189bc1f0 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b3f5c080034b658cbfb311c0c77b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b63567b3e54cf1a4348fb65b65a040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:01.187160 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-f82fd3a0-0f84-4efd-8366-7427189bc1f0 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] 10.222.0.85 "GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37" status: 200 len: 1263 microversion: 2.1 time: 0.083441 Jun 07 14:49:01.187709 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 454/914] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:49:01 2022] GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37 => generated 1263 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:49:01.333352 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-9fc227d3-6173-4288-897b-63f78c58a6f0 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:01.333971 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-9fc227d3-6173-4288-897b-63f78c58a6f0 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: 89db7091-f026-4913-962e-ad45fd38b468] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:01.340526 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-9fc227d3-6173-4288-897b-63f78c58a6f0 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:01.340977 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-9fc227d3-6173-4288-897b-63f78c58a6f0 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:01.341749 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-9fc227d3-6173-4288-897b-63f78c58a6f0 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:01.342190 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-9fc227d3-6173-4288-897b-63f78c58a6f0 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:01.471724 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-9fc227d3-6173-4288-897b-63f78c58a6f0 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:01.479896 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-9fc227d3-6173-4288-897b-63f78c58a6f0 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:01.481916 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-9fc227d3-6173-4288-897b-63f78c58a6f0 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:01.485230 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-9fc227d3-6173-4288-897b-63f78c58a6f0 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468" status: 200 len: 1736 microversion: 2.20 time: 0.154007 Jun 07 14:49:01.485230 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 461/915] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:49:01 2022] GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:49:02.210674 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-a60045d1-f41a-4c5f-824d-efac8c696b51 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:02.210674 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-a60045d1-f41a-4c5f-824d-efac8c696b51 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] [instance: 75e38ceb-ae6e-456f-968b-90e5f4f39d37] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:02.211174 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-a60045d1-f41a-4c5f-824d-efac8c696b51 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:02.211631 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-a60045d1-f41a-4c5f-824d-efac8c696b51 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:02.212440 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-a60045d1-f41a-4c5f-824d-efac8c696b51 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:02.212880 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-a60045d1-f41a-4c5f-824d-efac8c696b51 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:02.294323 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-a60045d1-f41a-4c5f-824d-efac8c696b51 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b3f5c080034b658cbfb311c0c77b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b63567b3e54cf1a4348fb65b65a040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:02.298641 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-a60045d1-f41a-4c5f-824d-efac8c696b51 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] 10.222.0.85 "GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37" status: 200 len: 1311 microversion: 2.1 time: 0.099034 Jun 07 14:49:02.299198 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 455/916] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:49:02 2022] GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37 => generated 1311 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:49:02.427004 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-1ac3e4f3-abcb-4a75-94cb-7f27599c737f tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:02.428016 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-1ac3e4f3-abcb-4a75-94cb-7f27599c737f tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e038fb54-192d-4af5-a273-955b1493d4b4] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:02.434893 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-1ac3e4f3-abcb-4a75-94cb-7f27599c737f tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:02.441775 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-1ac3e4f3-abcb-4a75-94cb-7f27599c737f tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:02.441775 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-1ac3e4f3-abcb-4a75-94cb-7f27599c737f tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:02.441775 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-1ac3e4f3-abcb-4a75-94cb-7f27599c737f tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:02.465023 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-1ac3e4f3-abcb-4a75-94cb-7f27599c737f tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e038fb54-192d-4af5-a273-955b1493d4b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041886 Jun 07 14:49:02.465487 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 462/917] 10.222.0.85 () {58 vars in 1301 bytes} [Tue Jun 7 14:49:02 2022] GET /compute/v2.1/servers/e038fb54-192d-4af5-a273-955b1493d4b4/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:49:02.475219 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-22641576-f65c-422f-a045-e160a3cd3ccf tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:02.475709 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-22641576-f65c-422f-a045-e160a3cd3ccf tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e038fb54-192d-4af5-a273-955b1493d4b4] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:02.481634 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-22641576-f65c-422f-a045-e160a3cd3ccf tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:02.482080 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-22641576-f65c-422f-a045-e160a3cd3ccf tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:02.482831 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-22641576-f65c-422f-a045-e160a3cd3ccf tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:02.483259 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-22641576-f65c-422f-a045-e160a3cd3ccf tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:02.502312 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-2f717741-b423-4d30-8e72-7b10fa417332 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:02.502921 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-2f717741-b423-4d30-8e72-7b10fa417332 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: 89db7091-f026-4913-962e-ad45fd38b468] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:02.508864 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-2f717741-b423-4d30-8e72-7b10fa417332 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:02.509304 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-2f717741-b423-4d30-8e72-7b10fa417332 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:02.510157 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-2f717741-b423-4d30-8e72-7b10fa417332 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:02.510593 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-2f717741-b423-4d30-8e72-7b10fa417332 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:02.515126 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-22641576-f65c-422f-a045-e160a3cd3ccf tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e038fb54-192d-4af5-a273-955b1493d4b4/os-volume_attachments/d005f9f8-ff50-4e2b-8940-0a4b2d313083" status: 200 len: 194 microversion: 2.1 time: 0.043728 Jun 07 14:49:02.515706 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 456/918] 10.222.0.85 () {58 vars in 1412 bytes} [Tue Jun 7 14:49:02 2022] GET /compute/v2.1/servers/e038fb54-192d-4af5-a273-955b1493d4b4/os-volume_attachments/d005f9f8-ff50-4e2b-8940-0a4b2d313083 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 14:49:02.661077 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-2f717741-b423-4d30-8e72-7b10fa417332 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:02.686482 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-2f717741-b423-4d30-8e72-7b10fa417332 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:02.688060 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-2f717741-b423-4d30-8e72-7b10fa417332 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:02.694626 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-2f717741-b423-4d30-8e72-7b10fa417332 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468" status: 200 len: 1718 microversion: 2.20 time: 0.190918 Jun 07 14:49:02.700791 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 463/919] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:49:02 2022] GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468 => generated 1718 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 14:49:03.315520 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-447d69ab-120e-44a0-9f8b-c5c2c46920b9 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:03.316069 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-447d69ab-120e-44a0-9f8b-c5c2c46920b9 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] [instance: 75e38ceb-ae6e-456f-968b-90e5f4f39d37] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:03.322579 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-447d69ab-120e-44a0-9f8b-c5c2c46920b9 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:03.323040 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-447d69ab-120e-44a0-9f8b-c5c2c46920b9 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:03.323809 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-447d69ab-120e-44a0-9f8b-c5c2c46920b9 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:03.324919 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-447d69ab-120e-44a0-9f8b-c5c2c46920b9 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:03.390537 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-447d69ab-120e-44a0-9f8b-c5c2c46920b9 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b3f5c080034b658cbfb311c0c77b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b63567b3e54cf1a4348fb65b65a040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:03.398185 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-447d69ab-120e-44a0-9f8b-c5c2c46920b9 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] 10.222.0.85 "GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37" status: 200 len: 1319 microversion: 2.1 time: 0.086550 Jun 07 14:49:03.398743 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 457/920] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:49:03 2022] GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37 => generated 1319 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:49:03.708312 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-0cac0996-5995-497b-bfe8-1dfc377f5707 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:03.708952 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-0cac0996-5995-497b-bfe8-1dfc377f5707 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: 89db7091-f026-4913-962e-ad45fd38b468] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:03.715424 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-0cac0996-5995-497b-bfe8-1dfc377f5707 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:03.715864 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-0cac0996-5995-497b-bfe8-1dfc377f5707 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:03.716758 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-0cac0996-5995-497b-bfe8-1dfc377f5707 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:03.717192 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-0cac0996-5995-497b-bfe8-1dfc377f5707 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:03.844354 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-0cac0996-5995-497b-bfe8-1dfc377f5707 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:03.852255 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-0cac0996-5995-497b-bfe8-1dfc377f5707 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:03.853787 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-0cac0996-5995-497b-bfe8-1dfc377f5707 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:03.854946 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-0cac0996-5995-497b-bfe8-1dfc377f5707 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468" status: 200 len: 1718 microversion: 2.20 time: 0.150524 Jun 07 14:49:03.856012 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 464/921] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:49:03 2022] GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468 => generated 1718 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:49:04.172662 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-bf986379-7579-45a5-9427-c52e801ba0af tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8c114450-27fc-433c-9984-54219ce344d7"}} {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:49:04.173749 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-bf986379-7579-45a5-9427-c52e801ba0af tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e038fb54-192d-4af5-a273-955b1493d4b4] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:04.179839 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-bf986379-7579-45a5-9427-c52e801ba0af tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:04.182584 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-bf986379-7579-45a5-9427-c52e801ba0af tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:04.182584 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-bf986379-7579-45a5-9427-c52e801ba0af tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:04.182584 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-bf986379-7579-45a5-9427-c52e801ba0af tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:04.416227 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-d1ab0a59-b9e8-4c0f-877f-09d69367c878 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:04.417174 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-d1ab0a59-b9e8-4c0f-877f-09d69367c878 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] [instance: 75e38ceb-ae6e-456f-968b-90e5f4f39d37] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:04.426255 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-d1ab0a59-b9e8-4c0f-877f-09d69367c878 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:04.427099 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-d1ab0a59-b9e8-4c0f-877f-09d69367c878 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:04.428527 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-d1ab0a59-b9e8-4c0f-877f-09d69367c878 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:04.429156 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-d1ab0a59-b9e8-4c0f-877f-09d69367c878 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:04.502146 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-d1ab0a59-b9e8-4c0f-877f-09d69367c878 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b3f5c080034b658cbfb311c0c77b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b63567b3e54cf1a4348fb65b65a040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:04.512103 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-d1ab0a59-b9e8-4c0f-877f-09d69367c878 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] 10.222.0.85 "GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37" status: 200 len: 1319 microversion: 2.1 time: 0.100138 Jun 07 14:49:04.513058 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 465/922] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:49:04 2022] GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37 => generated 1319 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:49:04.621299 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [req-1ca4ed14-35c2-4ba0-81c6-c35e853a331a req-02ce812a-255e-498d-9c71-ea7d61eda0e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89db7091-f026-4913-962e-ad45fd38b468", "name": "network-vif-unplugged", "status": "completed", "tag": "cf25b5fc-6d60-40d5-8461-593838e20baf"}]} {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:49:04.630159 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [req-1ca4ed14-35c2-4ba0-81c6-c35e853a331a req-02ce812a-255e-498d-9c71-ea7d61eda0e3 service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:04.630684 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [req-1ca4ed14-35c2-4ba0-81c6-c35e853a331a req-02ce812a-255e-498d-9c71-ea7d61eda0e3 service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:04.642593 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.compute.server_external_events [req-1ca4ed14-35c2-4ba0-81c6-c35e853a331a req-02ce812a-255e-498d-9c71-ea7d61eda0e3 service nova] Creating event network-vif-unplugged:cf25b5fc-6d60-40d5-8461-593838e20baf for instance 89db7091-f026-4913-962e-ad45fd38b468 on hv-cinder-84497 Jun 07 14:49:04.647963 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [req-1ca4ed14-35c2-4ba0-81c6-c35e853a331a req-02ce812a-255e-498d-9c71-ea7d61eda0e3 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030517 Jun 07 14:49:04.649232 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 466/923] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jun 7 14:49:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 14:49:04.875376 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-e6ad3fa5-1a07-491c-bf0d-d1e48e2f6d62 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:04.876093 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-e6ad3fa5-1a07-491c-bf0d-d1e48e2f6d62 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: 89db7091-f026-4913-962e-ad45fd38b468] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:04.882370 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-e6ad3fa5-1a07-491c-bf0d-d1e48e2f6d62 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:04.882821 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-e6ad3fa5-1a07-491c-bf0d-d1e48e2f6d62 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:04.883588 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-e6ad3fa5-1a07-491c-bf0d-d1e48e2f6d62 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:04.884027 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-e6ad3fa5-1a07-491c-bf0d-d1e48e2f6d62 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:04.887724 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG dbcounter [-] [118158] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:49:05.052726 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-bf986379-7579-45a5-9427-c52e801ba0af tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "POST /compute/v2.1/servers/e038fb54-192d-4af5-a273-955b1493d4b4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.883430 Jun 07 14:49:05.053496 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-e6ad3fa5-1a07-491c-bf0d-d1e48e2f6d62 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:05.068960 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 458/924] 10.222.0.85 () {60 vars in 1322 bytes} [Tue Jun 7 14:49:04 2022] POST /compute/v2.1/servers/e038fb54-192d-4af5-a273-955b1493d4b4/os-volume_attachments => generated 194 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:49:05.069239 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-e6ad3fa5-1a07-491c-bf0d-d1e48e2f6d62 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:05.070936 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-e6ad3fa5-1a07-491c-bf0d-d1e48e2f6d62 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:05.072482 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-e6ad3fa5-1a07-491c-bf0d-d1e48e2f6d62 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468" status: 200 len: 1721 microversion: 2.20 time: 0.202262 Jun 07 14:49:05.073208 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 467/925] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:49:04 2022] GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468 => generated 1721 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 14:49:05.102242 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-b0971016-f298-44aa-bb99-71c3112b2240 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7205f329-c65f-499b-8248-34f371975cba"}} {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:49:05.104421 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-b0971016-f298-44aa-bb99-71c3112b2240 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: 89db7091-f026-4913-962e-ad45fd38b468] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:05.111005 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-b0971016-f298-44aa-bb99-71c3112b2240 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:05.111473 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-b0971016-f298-44aa-bb99-71c3112b2240 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:05.112325 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-b0971016-f298-44aa-bb99-71c3112b2240 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:05.112973 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-b0971016-f298-44aa-bb99-71c3112b2240 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:05.217204 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG dbcounter [-] [118157] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:49:05.530105 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-e91b4f4d-3a4c-48b9-a556-831de7deda83 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:05.531023 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-e91b4f4d-3a4c-48b9-a556-831de7deda83 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] [instance: 75e38ceb-ae6e-456f-968b-90e5f4f39d37] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:05.537579 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-e91b4f4d-3a4c-48b9-a556-831de7deda83 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:05.543049 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-e91b4f4d-3a4c-48b9-a556-831de7deda83 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:05.547793 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-e91b4f4d-3a4c-48b9-a556-831de7deda83 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:05.547793 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-e91b4f4d-3a4c-48b9-a556-831de7deda83 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:05.766290 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-e91b4f4d-3a4c-48b9-a556-831de7deda83 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b3f5c080034b658cbfb311c0c77b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b63567b3e54cf1a4348fb65b65a040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:05.776532 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-e91b4f4d-3a4c-48b9-a556-831de7deda83 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] 10.222.0.85 "GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37" status: 200 len: 1359 microversion: 2.1 time: 0.250757 Jun 07 14:49:05.777665 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 468/926] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:49:05 2022] GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37 => generated 1359 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:49:06.168500 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-b0971016-f298-44aa-bb99-71c3112b2240 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "POST /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.069967 Jun 07 14:49:06.174501 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 459/927] 10.222.0.85 () {62 vars in 1363 bytes} [Tue Jun 7 14:49:05 2022] POST /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468/os-volume_attachments => generated 188 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 14:49:06.327949 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-bc18c17a-df14-4637-8eff-04813dbb3cdc tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:06.331231 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-bc18c17a-df14-4637-8eff-04813dbb3cdc tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: 89db7091-f026-4913-962e-ad45fd38b468] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:06.338898 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-bc18c17a-df14-4637-8eff-04813dbb3cdc tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:06.339792 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-bc18c17a-df14-4637-8eff-04813dbb3cdc tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:06.340916 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-bc18c17a-df14-4637-8eff-04813dbb3cdc tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:06.341504 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-bc18c17a-df14-4637-8eff-04813dbb3cdc tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:06.366284 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [req-cf3be3bb-931d-4125-92d6-5223efb9b279 req-d45b1d48-4c15-4b21-a549-eff154936bb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75e38ceb-ae6e-456f-968b-90e5f4f39d37", "tag": "7b71f53f-1ebd-4fef-9f3d-7b046f3f3a49"}]} {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:49:06.384233 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [req-cf3be3bb-931d-4125-92d6-5223efb9b279 req-d45b1d48-4c15-4b21-a549-eff154936bb1 service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:06.385008 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [req-cf3be3bb-931d-4125-92d6-5223efb9b279 req-d45b1d48-4c15-4b21-a549-eff154936bb1 service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:06.417139 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.compute.server_external_events [req-cf3be3bb-931d-4125-92d6-5223efb9b279 req-d45b1d48-4c15-4b21-a549-eff154936bb1 service nova] Creating event network-changed:7b71f53f-1ebd-4fef-9f3d-7b046f3f3a49 for instance 75e38ceb-ae6e-456f-968b-90e5f4f39d37 on hv-cinder-84497 Jun 07 14:49:06.428880 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [req-cf3be3bb-931d-4125-92d6-5223efb9b279 req-d45b1d48-4c15-4b21-a549-eff154936bb1 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072249 Jun 07 14:49:06.432189 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 460/928] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jun 7 14:49:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 14:49:06.796616 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-dd3974a5-37c3-4ce9-869d-dbb6324f6e9a tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:06.797591 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-dd3974a5-37c3-4ce9-869d-dbb6324f6e9a tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] [instance: 75e38ceb-ae6e-456f-968b-90e5f4f39d37] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:06.806674 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-dd3974a5-37c3-4ce9-869d-dbb6324f6e9a tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:06.807130 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-dd3974a5-37c3-4ce9-869d-dbb6324f6e9a tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:06.807923 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-dd3974a5-37c3-4ce9-869d-dbb6324f6e9a tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:06.808435 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-dd3974a5-37c3-4ce9-869d-dbb6324f6e9a tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:06.967591 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-dd3974a5-37c3-4ce9-869d-dbb6324f6e9a tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b3f5c080034b658cbfb311c0c77b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b63567b3e54cf1a4348fb65b65a040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:06.975935 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-dd3974a5-37c3-4ce9-869d-dbb6324f6e9a tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] 10.222.0.85 "GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37" status: 200 len: 1359 microversion: 2.1 time: 0.184892 Jun 07 14:49:06.976641 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 461/929] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:49:06 2022] GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37 => generated 1359 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:49:07.104533 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-bc18c17a-df14-4637-8eff-04813dbb3cdc tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "DELETE /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468/os-volume_attachments/7205f329-c65f-499b-8248-34f371975cba" status: 202 len: 0 microversion: 2.20 time: 0.781088 Jun 07 14:49:07.105570 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 469/930] 10.222.0.85 () {60 vars in 1456 bytes} [Tue Jun 7 14:49:06 2022] DELETE /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468/os-volume_attachments/7205f329-c65f-499b-8248-34f371975cba => generated 0 bytes in 783 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 07 14:49:07.167188 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-f5519d64-5e7f-46cc-9a41-354b7f81b0a3 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:49:07.173303 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-f5519d64-5e7f-46cc-9a41-354b7f81b0a3 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: 89db7091-f026-4913-962e-ad45fd38b468] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:07.173947 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-f5519d64-5e7f-46cc-9a41-354b7f81b0a3 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:07.174362 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-f5519d64-5e7f-46cc-9a41-354b7f81b0a3 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:07.175142 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-f5519d64-5e7f-46cc-9a41-354b7f81b0a3 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:07.175582 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-f5519d64-5e7f-46cc-9a41-354b7f81b0a3 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:07.401477 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-f5519d64-5e7f-46cc-9a41-354b7f81b0a3 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "POST /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468/action" status: 202 len: 0 microversion: 2.20 time: 0.238066 Jun 07 14:49:07.402094 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 462/931] 10.222.0.85 () {62 vars in 1318 bytes} [Tue Jun 7 14:49:07 2022] POST /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468/action => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 07 14:49:07.410744 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-312a3900-ceca-4039-9927-43169e06a283 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:07.411454 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-312a3900-ceca-4039-9927-43169e06a283 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: 89db7091-f026-4913-962e-ad45fd38b468] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:07.423088 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-312a3900-ceca-4039-9927-43169e06a283 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:07.423618 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-312a3900-ceca-4039-9927-43169e06a283 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:07.427596 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-312a3900-ceca-4039-9927-43169e06a283 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:07.427596 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-312a3900-ceca-4039-9927-43169e06a283 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:07.575430 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-312a3900-ceca-4039-9927-43169e06a283 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:07.583568 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-312a3900-ceca-4039-9927-43169e06a283 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:07.585134 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-312a3900-ceca-4039-9927-43169e06a283 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:07.586273 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-312a3900-ceca-4039-9927-43169e06a283 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468" status: 200 len: 1669 microversion: 2.20 time: 0.179736 Jun 07 14:49:07.586821 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 470/932] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:49:07 2022] GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468 => generated 1669 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:49:07.997304 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-970cd3ac-1a83-4303-97a0-c099bbaf8a99 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:07.998678 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-970cd3ac-1a83-4303-97a0-c099bbaf8a99 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] [instance: 75e38ceb-ae6e-456f-968b-90e5f4f39d37] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:08.009703 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-970cd3ac-1a83-4303-97a0-c099bbaf8a99 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:08.010433 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-970cd3ac-1a83-4303-97a0-c099bbaf8a99 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:08.012550 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-970cd3ac-1a83-4303-97a0-c099bbaf8a99 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:08.013286 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-970cd3ac-1a83-4303-97a0-c099bbaf8a99 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:08.192404 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-970cd3ac-1a83-4303-97a0-c099bbaf8a99 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b3f5c080034b658cbfb311c0c77b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b63567b3e54cf1a4348fb65b65a040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:08.200755 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-970cd3ac-1a83-4303-97a0-c099bbaf8a99 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] 10.222.0.85 "GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37" status: 200 len: 1359 microversion: 2.1 time: 0.211290 Jun 07 14:49:08.201670 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 463/933] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:49:07 2022] GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37 => generated 1359 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:49:08.605263 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-d6d72355-2190-4811-aa8c-abc461d47c9b tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:08.605956 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-d6d72355-2190-4811-aa8c-abc461d47c9b tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: 89db7091-f026-4913-962e-ad45fd38b468] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:08.608108 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG dbcounter [-] [118158] Writing DB stats nova_cell0:SELECT=2 {{(pid=118158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:49:08.608811 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG dbcounter [-] [118158] Writing DB stats nova_cell0:SELECT=6 {{(pid=118158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:49:08.614109 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-d6d72355-2190-4811-aa8c-abc461d47c9b tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:08.614567 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-d6d72355-2190-4811-aa8c-abc461d47c9b tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:08.615353 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-d6d72355-2190-4811-aa8c-abc461d47c9b tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:08.615973 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-d6d72355-2190-4811-aa8c-abc461d47c9b tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:08.760755 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-d6d72355-2190-4811-aa8c-abc461d47c9b tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:08.780394 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-d6d72355-2190-4811-aa8c-abc461d47c9b tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:08.782126 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-d6d72355-2190-4811-aa8c-abc461d47c9b tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:08.783494 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-d6d72355-2190-4811-aa8c-abc461d47c9b tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468" status: 200 len: 1669 microversion: 2.20 time: 0.182186 Jun 07 14:49:08.784288 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 471/934] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:49:08 2022] GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468 => generated 1669 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:49:09.218490 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-bdb2a694-7e91-4f67-a2f9-f4bac1425439 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:09.219113 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-bdb2a694-7e91-4f67-a2f9-f4bac1425439 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] [instance: 75e38ceb-ae6e-456f-968b-90e5f4f39d37] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:09.225877 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-bdb2a694-7e91-4f67-a2f9-f4bac1425439 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:09.226406 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-bdb2a694-7e91-4f67-a2f9-f4bac1425439 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:09.227486 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-bdb2a694-7e91-4f67-a2f9-f4bac1425439 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:09.227933 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-bdb2a694-7e91-4f67-a2f9-f4bac1425439 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:09.378474 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-bdb2a694-7e91-4f67-a2f9-f4bac1425439 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b3f5c080034b658cbfb311c0c77b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b63567b3e54cf1a4348fb65b65a040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:09.389334 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-bdb2a694-7e91-4f67-a2f9-f4bac1425439 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] 10.222.0.85 "GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37" status: 200 len: 1359 microversion: 2.1 time: 0.175271 Jun 07 14:49:09.398736 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 464/935] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:49:09 2022] GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37 => generated 1359 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:49:09.803398 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-d351f0f2-f9ac-4cb1-bef3-e4946d5605fe tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:09.804748 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-d351f0f2-f9ac-4cb1-bef3-e4946d5605fe tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: 89db7091-f026-4913-962e-ad45fd38b468] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:09.812084 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-d351f0f2-f9ac-4cb1-bef3-e4946d5605fe tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:09.812849 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-d351f0f2-f9ac-4cb1-bef3-e4946d5605fe tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:09.813826 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-d351f0f2-f9ac-4cb1-bef3-e4946d5605fe tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:09.814267 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-d351f0f2-f9ac-4cb1-bef3-e4946d5605fe tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:09.962517 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-d351f0f2-f9ac-4cb1-bef3-e4946d5605fe tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:09.972592 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-d351f0f2-f9ac-4cb1-bef3-e4946d5605fe tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:09.974369 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-d351f0f2-f9ac-4cb1-bef3-e4946d5605fe tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:09.975555 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-d351f0f2-f9ac-4cb1-bef3-e4946d5605fe tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468" status: 200 len: 1669 microversion: 2.20 time: 0.176452 Jun 07 14:49:09.976126 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 472/936] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:49:09 2022] GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468 => generated 1669 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:49:10.406592 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-17eac556-c5f4-4d8b-88be-e37d64796a95 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:10.407218 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-17eac556-c5f4-4d8b-88be-e37d64796a95 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] [instance: 75e38ceb-ae6e-456f-968b-90e5f4f39d37] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:10.409952 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG dbcounter [-] [118157] Writing DB stats nova_cell0:SELECT=8 {{(pid=118157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:49:10.416539 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-17eac556-c5f4-4d8b-88be-e37d64796a95 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:10.417082 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-17eac556-c5f4-4d8b-88be-e37d64796a95 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:10.418381 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-17eac556-c5f4-4d8b-88be-e37d64796a95 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:10.418851 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-17eac556-c5f4-4d8b-88be-e37d64796a95 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:10.570252 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-17eac556-c5f4-4d8b-88be-e37d64796a95 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b3f5c080034b658cbfb311c0c77b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b63567b3e54cf1a4348fb65b65a040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:10.577793 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-17eac556-c5f4-4d8b-88be-e37d64796a95 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] 10.222.0.85 "GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37" status: 200 len: 1359 microversion: 2.1 time: 0.175901 Jun 07 14:49:10.587392 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 465/937] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:49:10 2022] GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37 => generated 1359 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:49:10.993108 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-7ca55882-e194-4bbd-bb19-9a93948814ad tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:10.993914 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-7ca55882-e194-4bbd-bb19-9a93948814ad tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: 89db7091-f026-4913-962e-ad45fd38b468] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:11.000788 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-7ca55882-e194-4bbd-bb19-9a93948814ad tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:11.002002 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-7ca55882-e194-4bbd-bb19-9a93948814ad tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:11.003359 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-7ca55882-e194-4bbd-bb19-9a93948814ad tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:11.004243 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-7ca55882-e194-4bbd-bb19-9a93948814ad tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:11.147799 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-7ca55882-e194-4bbd-bb19-9a93948814ad tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:11.157651 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-7ca55882-e194-4bbd-bb19-9a93948814ad tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:11.159327 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-7ca55882-e194-4bbd-bb19-9a93948814ad tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:11.160619 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-7ca55882-e194-4bbd-bb19-9a93948814ad tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468" status: 200 len: 1669 microversion: 2.20 time: 0.171302 Jun 07 14:49:11.165474 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 473/938] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:49:10 2022] GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468 => generated 1669 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:49:11.595435 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-d071263f-9429-4a09-bc75-466f8c5910d8 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:11.596153 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-d071263f-9429-4a09-bc75-466f8c5910d8 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] [instance: 75e38ceb-ae6e-456f-968b-90e5f4f39d37] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:11.602794 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-d071263f-9429-4a09-bc75-466f8c5910d8 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:11.603230 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-d071263f-9429-4a09-bc75-466f8c5910d8 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:11.604044 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-d071263f-9429-4a09-bc75-466f8c5910d8 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:11.604495 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-d071263f-9429-4a09-bc75-466f8c5910d8 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:11.737072 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-d071263f-9429-4a09-bc75-466f8c5910d8 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b3f5c080034b658cbfb311c0c77b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b63567b3e54cf1a4348fb65b65a040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:11.747043 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-d071263f-9429-4a09-bc75-466f8c5910d8 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] 10.222.0.85 "GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37" status: 200 len: 1359 microversion: 2.1 time: 0.155335 Jun 07 14:49:11.747896 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 466/939] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:49:11 2022] GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37 => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:49:12.186011 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-c7804634-c3cf-4755-948c-e2df69eb5754 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:12.186575 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-c7804634-c3cf-4755-948c-e2df69eb5754 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: 89db7091-f026-4913-962e-ad45fd38b468] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:12.193476 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-c7804634-c3cf-4755-948c-e2df69eb5754 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:12.193933 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-c7804634-c3cf-4755-948c-e2df69eb5754 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:12.194812 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-c7804634-c3cf-4755-948c-e2df69eb5754 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:12.195235 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-c7804634-c3cf-4755-948c-e2df69eb5754 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:12.352338 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-c7804634-c3cf-4755-948c-e2df69eb5754 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:12.361218 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-c7804634-c3cf-4755-948c-e2df69eb5754 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:12.363071 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-c7804634-c3cf-4755-948c-e2df69eb5754 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:12.364246 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-c7804634-c3cf-4755-948c-e2df69eb5754 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468" status: 200 len: 1669 microversion: 2.20 time: 0.182422 Jun 07 14:49:12.365069 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 474/940] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:49:12 2022] GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468 => generated 1669 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:49:12.763547 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-60bbc598-84eb-4875-a64f-097f988de93e tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:12.764271 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-60bbc598-84eb-4875-a64f-097f988de93e tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] [instance: 75e38ceb-ae6e-456f-968b-90e5f4f39d37] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:12.771111 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-60bbc598-84eb-4875-a64f-097f988de93e tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:12.771570 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-60bbc598-84eb-4875-a64f-097f988de93e tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:12.772346 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-60bbc598-84eb-4875-a64f-097f988de93e tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:12.772832 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-60bbc598-84eb-4875-a64f-097f988de93e tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:12.913241 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-60bbc598-84eb-4875-a64f-097f988de93e tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b3f5c080034b658cbfb311c0c77b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b63567b3e54cf1a4348fb65b65a040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:12.920961 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-60bbc598-84eb-4875-a64f-097f988de93e tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] 10.222.0.85 "GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37" status: 200 len: 1359 microversion: 2.1 time: 0.161545 Jun 07 14:49:12.921824 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 467/941] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:49:12 2022] GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37 => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:49:13.383097 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-ee79e835-a54b-457a-b16f-38a65703bc7c tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:13.383724 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-ee79e835-a54b-457a-b16f-38a65703bc7c tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: 89db7091-f026-4913-962e-ad45fd38b468] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:13.390799 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-ee79e835-a54b-457a-b16f-38a65703bc7c tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:13.391371 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-ee79e835-a54b-457a-b16f-38a65703bc7c tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:13.392398 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-ee79e835-a54b-457a-b16f-38a65703bc7c tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:13.392849 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-ee79e835-a54b-457a-b16f-38a65703bc7c tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:13.532319 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-ee79e835-a54b-457a-b16f-38a65703bc7c tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:13.540989 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-ee79e835-a54b-457a-b16f-38a65703bc7c tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:13.542529 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-ee79e835-a54b-457a-b16f-38a65703bc7c tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:13.544476 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-ee79e835-a54b-457a-b16f-38a65703bc7c tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468" status: 200 len: 1669 microversion: 2.20 time: 0.165307 Jun 07 14:49:13.545048 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 475/942] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:49:13 2022] GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468 => generated 1669 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:49:13.938963 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-ff7065c9-9b61-4453-8163-0b6567a2d213 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:13.940302 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-ff7065c9-9b61-4453-8163-0b6567a2d213 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] [instance: 75e38ceb-ae6e-456f-968b-90e5f4f39d37] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:13.947573 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-ff7065c9-9b61-4453-8163-0b6567a2d213 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:13.948129 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-ff7065c9-9b61-4453-8163-0b6567a2d213 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:13.948981 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-ff7065c9-9b61-4453-8163-0b6567a2d213 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:13.949426 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-ff7065c9-9b61-4453-8163-0b6567a2d213 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:14.080798 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-ff7065c9-9b61-4453-8163-0b6567a2d213 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b3f5c080034b658cbfb311c0c77b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b63567b3e54cf1a4348fb65b65a040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:14.089031 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-ff7065c9-9b61-4453-8163-0b6567a2d213 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] 10.222.0.85 "GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37" status: 200 len: 1359 microversion: 2.1 time: 0.154768 Jun 07 14:49:14.089587 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 468/943] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:49:13 2022] GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37 => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:49:14.563362 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-3e4598ea-8d8d-4a04-a391-da9c144713c7 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:14.563932 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-3e4598ea-8d8d-4a04-a391-da9c144713c7 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: 89db7091-f026-4913-962e-ad45fd38b468] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:14.570361 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-3e4598ea-8d8d-4a04-a391-da9c144713c7 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:14.570806 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-3e4598ea-8d8d-4a04-a391-da9c144713c7 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:14.571610 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-3e4598ea-8d8d-4a04-a391-da9c144713c7 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:14.572044 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-3e4598ea-8d8d-4a04-a391-da9c144713c7 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:14.701713 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-3e4598ea-8d8d-4a04-a391-da9c144713c7 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:14.709569 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-3e4598ea-8d8d-4a04-a391-da9c144713c7 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:14.711075 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-3e4598ea-8d8d-4a04-a391-da9c144713c7 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:14.712236 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-3e4598ea-8d8d-4a04-a391-da9c144713c7 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468" status: 200 len: 1669 microversion: 2.20 time: 0.152922 Jun 07 14:49:14.712809 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 476/944] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:49:14 2022] GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468 => generated 1669 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:49:15.106767 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-1be5c5fe-cd22-4e7f-acf8-f109b26b89fd tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:15.107385 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-1be5c5fe-cd22-4e7f-acf8-f109b26b89fd tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] [instance: 75e38ceb-ae6e-456f-968b-90e5f4f39d37] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:15.114032 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-1be5c5fe-cd22-4e7f-acf8-f109b26b89fd tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:15.114479 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-1be5c5fe-cd22-4e7f-acf8-f109b26b89fd tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:15.115242 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-1be5c5fe-cd22-4e7f-acf8-f109b26b89fd tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:15.115679 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-1be5c5fe-cd22-4e7f-acf8-f109b26b89fd tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:15.241186 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-1be5c5fe-cd22-4e7f-acf8-f109b26b89fd tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b3f5c080034b658cbfb311c0c77b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b63567b3e54cf1a4348fb65b65a040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:15.248526 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-1be5c5fe-cd22-4e7f-acf8-f109b26b89fd tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] 10.222.0.85 "GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37" status: 200 len: 1359 microversion: 2.1 time: 0.146115 Jun 07 14:49:15.249082 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 469/945] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:49:15 2022] GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37 => generated 1359 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:49:15.731448 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-3b3b5b9d-a60c-4118-adc1-0b57987e1f01 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:15.732062 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-3b3b5b9d-a60c-4118-adc1-0b57987e1f01 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: 89db7091-f026-4913-962e-ad45fd38b468] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:15.738632 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-3b3b5b9d-a60c-4118-adc1-0b57987e1f01 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:15.739137 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-3b3b5b9d-a60c-4118-adc1-0b57987e1f01 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:15.739906 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-3b3b5b9d-a60c-4118-adc1-0b57987e1f01 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:15.740344 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-3b3b5b9d-a60c-4118-adc1-0b57987e1f01 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:16.029497 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-3b3b5b9d-a60c-4118-adc1-0b57987e1f01 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:16.037453 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-3b3b5b9d-a60c-4118-adc1-0b57987e1f01 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:16.038938 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-3b3b5b9d-a60c-4118-adc1-0b57987e1f01 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:16.040080 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-3b3b5b9d-a60c-4118-adc1-0b57987e1f01 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468" status: 200 len: 1669 microversion: 2.20 time: 0.313105 Jun 07 14:49:16.040660 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 477/946] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:49:15 2022] GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468 => generated 1669 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:49:16.265359 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-9f23ab29-d445-4fc6-8d89-b4eade57f914 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:16.266004 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-9f23ab29-d445-4fc6-8d89-b4eade57f914 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] [instance: 75e38ceb-ae6e-456f-968b-90e5f4f39d37] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:16.272605 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-9f23ab29-d445-4fc6-8d89-b4eade57f914 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:16.273063 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-9f23ab29-d445-4fc6-8d89-b4eade57f914 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:16.273825 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-9f23ab29-d445-4fc6-8d89-b4eade57f914 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:16.274526 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-9f23ab29-d445-4fc6-8d89-b4eade57f914 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:16.419299 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-9f23ab29-d445-4fc6-8d89-b4eade57f914 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b3f5c080034b658cbfb311c0c77b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b63567b3e54cf1a4348fb65b65a040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:16.426819 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-9f23ab29-d445-4fc6-8d89-b4eade57f914 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] 10.222.0.85 "GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37" status: 200 len: 1359 microversion: 2.1 time: 0.165283 Jun 07 14:49:16.427381 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 470/947] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:49:16 2022] GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37 => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:49:17.059752 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-74c08c28-4cad-4f5f-81e9-9b1c0e816c95 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:17.061536 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-74c08c28-4cad-4f5f-81e9-9b1c0e816c95 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: 89db7091-f026-4913-962e-ad45fd38b468] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:17.068232 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-74c08c28-4cad-4f5f-81e9-9b1c0e816c95 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:17.068782 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-74c08c28-4cad-4f5f-81e9-9b1c0e816c95 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:17.069755 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-74c08c28-4cad-4f5f-81e9-9b1c0e816c95 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:17.070194 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-74c08c28-4cad-4f5f-81e9-9b1c0e816c95 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:17.215250 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-74c08c28-4cad-4f5f-81e9-9b1c0e816c95 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:17.223824 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-74c08c28-4cad-4f5f-81e9-9b1c0e816c95 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:17.238829 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-74c08c28-4cad-4f5f-81e9-9b1c0e816c95 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:17.238829 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-74c08c28-4cad-4f5f-81e9-9b1c0e816c95 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468" status: 200 len: 1671 microversion: 2.20 time: 0.171547 Jun 07 14:49:17.238829 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 478/948] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:49:17 2022] GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468 => generated 1671 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:49:17.443732 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-159d323d-40cf-44f6-a70c-4327d7251a19 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:17.444306 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-159d323d-40cf-44f6-a70c-4327d7251a19 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] [instance: 75e38ceb-ae6e-456f-968b-90e5f4f39d37] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:17.450899 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-159d323d-40cf-44f6-a70c-4327d7251a19 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:17.451352 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-159d323d-40cf-44f6-a70c-4327d7251a19 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:17.452155 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-159d323d-40cf-44f6-a70c-4327d7251a19 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:17.452620 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-159d323d-40cf-44f6-a70c-4327d7251a19 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:17.742973 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-159d323d-40cf-44f6-a70c-4327d7251a19 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b3f5c080034b658cbfb311c0c77b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b63567b3e54cf1a4348fb65b65a040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:17.750941 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-159d323d-40cf-44f6-a70c-4327d7251a19 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] 10.222.0.85 "GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37" status: 200 len: 1359 microversion: 2.1 time: 0.311074 Jun 07 14:49:17.751528 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 471/949] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:49:17 2022] GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37 => generated 1359 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:49:18.245765 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-603dfbeb-cbbb-4c88-b65e-fef921a664dc tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:18.246347 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-603dfbeb-cbbb-4c88-b65e-fef921a664dc tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: 89db7091-f026-4913-962e-ad45fd38b468] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:18.252993 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-603dfbeb-cbbb-4c88-b65e-fef921a664dc tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:18.253436 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-603dfbeb-cbbb-4c88-b65e-fef921a664dc tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:18.254187 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-603dfbeb-cbbb-4c88-b65e-fef921a664dc tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:18.254620 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-603dfbeb-cbbb-4c88-b65e-fef921a664dc tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:18.646879 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-603dfbeb-cbbb-4c88-b65e-fef921a664dc tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:18.654994 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-603dfbeb-cbbb-4c88-b65e-fef921a664dc tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:18.660196 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-603dfbeb-cbbb-4c88-b65e-fef921a664dc tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:18.660196 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-603dfbeb-cbbb-4c88-b65e-fef921a664dc tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468" status: 200 len: 1727 microversion: 2.20 time: 0.415955 Jun 07 14:49:18.660196 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 479/950] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:49:18 2022] GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468 => generated 1727 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:49:18.767451 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-0372ec17-90d7-42b9-9911-a2e62e7152f8 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:18.768071 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-0372ec17-90d7-42b9-9911-a2e62e7152f8 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] [instance: 75e38ceb-ae6e-456f-968b-90e5f4f39d37] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:18.774898 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-0372ec17-90d7-42b9-9911-a2e62e7152f8 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:18.775352 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-0372ec17-90d7-42b9-9911-a2e62e7152f8 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:18.776129 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-0372ec17-90d7-42b9-9911-a2e62e7152f8 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:18.776625 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-0372ec17-90d7-42b9-9911-a2e62e7152f8 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:18.905518 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-0372ec17-90d7-42b9-9911-a2e62e7152f8 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b3f5c080034b658cbfb311c0c77b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b63567b3e54cf1a4348fb65b65a040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:18.912952 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-0372ec17-90d7-42b9-9911-a2e62e7152f8 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] 10.222.0.85 "GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37" status: 200 len: 1359 microversion: 2.1 time: 0.149371 Jun 07 14:49:18.913524 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 472/951] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:49:18 2022] GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37 => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:49:19.676657 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-c764078b-fe16-4dae-bb0d-f61d593b456a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:19.677277 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-c764078b-fe16-4dae-bb0d-f61d593b456a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: 89db7091-f026-4913-962e-ad45fd38b468] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:19.683859 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-c764078b-fe16-4dae-bb0d-f61d593b456a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:19.684316 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-c764078b-fe16-4dae-bb0d-f61d593b456a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:19.685131 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-c764078b-fe16-4dae-bb0d-f61d593b456a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:19.685573 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-c764078b-fe16-4dae-bb0d-f61d593b456a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:19.815507 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-c764078b-fe16-4dae-bb0d-f61d593b456a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:19.823437 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-c764078b-fe16-4dae-bb0d-f61d593b456a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:19.824974 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-c764078b-fe16-4dae-bb0d-f61d593b456a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:19.826125 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-c764078b-fe16-4dae-bb0d-f61d593b456a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468" status: 200 len: 1727 microversion: 2.20 time: 0.153412 Jun 07 14:49:19.826671 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 480/952] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:49:19 2022] GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:49:19.930212 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-aaa14454-3682-41a5-978d-308c9eb0f512 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:19.930756 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-aaa14454-3682-41a5-978d-308c9eb0f512 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] [instance: 75e38ceb-ae6e-456f-968b-90e5f4f39d37] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:19.941399 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-aaa14454-3682-41a5-978d-308c9eb0f512 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:19.941399 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-aaa14454-3682-41a5-978d-308c9eb0f512 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:19.941399 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-aaa14454-3682-41a5-978d-308c9eb0f512 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:19.941399 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-aaa14454-3682-41a5-978d-308c9eb0f512 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:19.958544 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG dbcounter [-] [118157] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=118157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:49:20.122104 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-aaa14454-3682-41a5-978d-308c9eb0f512 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b3f5c080034b658cbfb311c0c77b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b63567b3e54cf1a4348fb65b65a040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:20.130086 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-aaa14454-3682-41a5-978d-308c9eb0f512 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] 10.222.0.85 "GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37" status: 200 len: 1359 microversion: 2.1 time: 0.203827 Jun 07 14:49:20.130724 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 473/953] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:49:19 2022] GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37 => generated 1359 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:49:20.843386 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-1b4a3d5e-9703-4409-a333-a9fe2b743095 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:20.843997 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-1b4a3d5e-9703-4409-a333-a9fe2b743095 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: 89db7091-f026-4913-962e-ad45fd38b468] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:20.850738 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-1b4a3d5e-9703-4409-a333-a9fe2b743095 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:20.851191 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-1b4a3d5e-9703-4409-a333-a9fe2b743095 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:20.851972 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-1b4a3d5e-9703-4409-a333-a9fe2b743095 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:20.852433 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-1b4a3d5e-9703-4409-a333-a9fe2b743095 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:20.887203 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG dbcounter [-] [118158] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=118158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:49:21.049385 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-1b4a3d5e-9703-4409-a333-a9fe2b743095 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:21.065302 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-1b4a3d5e-9703-4409-a333-a9fe2b743095 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:21.069022 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-1b4a3d5e-9703-4409-a333-a9fe2b743095 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:21.072287 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-1b4a3d5e-9703-4409-a333-a9fe2b743095 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468" status: 200 len: 1727 microversion: 2.20 time: 0.232762 Jun 07 14:49:21.072967 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 481/954] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:49:20 2022] GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468 => generated 1727 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:49:21.147428 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-14dfa7a0-576b-47b2-9638-c7cfcac5087b tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:21.149023 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-14dfa7a0-576b-47b2-9638-c7cfcac5087b tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] [instance: 75e38ceb-ae6e-456f-968b-90e5f4f39d37] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:21.157749 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-14dfa7a0-576b-47b2-9638-c7cfcac5087b tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:21.158276 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-14dfa7a0-576b-47b2-9638-c7cfcac5087b tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:21.159305 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-14dfa7a0-576b-47b2-9638-c7cfcac5087b tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:21.159746 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-14dfa7a0-576b-47b2-9638-c7cfcac5087b tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:21.362285 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-14dfa7a0-576b-47b2-9638-c7cfcac5087b tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b3f5c080034b658cbfb311c0c77b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b63567b3e54cf1a4348fb65b65a040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:21.372001 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-14dfa7a0-576b-47b2-9638-c7cfcac5087b tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] 10.222.0.85 "GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37" status: 200 len: 1359 microversion: 2.1 time: 0.227773 Jun 07 14:49:21.373327 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 474/955] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:49:21 2022] GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37 => generated 1359 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:49:22.092498 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-4b1a9bf8-6016-4442-b217-a28534b68df9 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:22.093133 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-4b1a9bf8-6016-4442-b217-a28534b68df9 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: 89db7091-f026-4913-962e-ad45fd38b468] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:22.100457 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-4b1a9bf8-6016-4442-b217-a28534b68df9 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:22.100908 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-4b1a9bf8-6016-4442-b217-a28534b68df9 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:22.101678 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-4b1a9bf8-6016-4442-b217-a28534b68df9 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:22.102108 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-4b1a9bf8-6016-4442-b217-a28534b68df9 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:22.249793 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-4b1a9bf8-6016-4442-b217-a28534b68df9 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:22.257900 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-4b1a9bf8-6016-4442-b217-a28534b68df9 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:22.259403 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-4b1a9bf8-6016-4442-b217-a28534b68df9 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:22.260610 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-4b1a9bf8-6016-4442-b217-a28534b68df9 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468" status: 200 len: 1727 microversion: 2.20 time: 0.173724 Jun 07 14:49:22.261175 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 482/956] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:49:22 2022] GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468 => generated 1727 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:49:22.388863 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-8afd9e48-9319-4567-8ebd-83087904416e tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:22.389490 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-8afd9e48-9319-4567-8ebd-83087904416e tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] [instance: 75e38ceb-ae6e-456f-968b-90e5f4f39d37] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:22.391849 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG dbcounter [-] [118157] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=1 {{(pid=118157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:49:22.398806 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-8afd9e48-9319-4567-8ebd-83087904416e tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:22.402688 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-8afd9e48-9319-4567-8ebd-83087904416e tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:22.402688 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-8afd9e48-9319-4567-8ebd-83087904416e tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:22.402688 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-8afd9e48-9319-4567-8ebd-83087904416e tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:22.563440 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-8afd9e48-9319-4567-8ebd-83087904416e tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b3f5c080034b658cbfb311c0c77b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b63567b3e54cf1a4348fb65b65a040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:22.572652 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-8afd9e48-9319-4567-8ebd-83087904416e tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] 10.222.0.85 "GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37" status: 200 len: 1359 microversion: 2.1 time: 0.187538 Jun 07 14:49:22.573379 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 475/957] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:49:22 2022] GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37 => generated 1359 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:49:22.818058 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [req-fb23253f-48d4-4077-832c-103fe44aaae2 req-bb22d0a3-e649-4e9c-a600-896e1d4f0b86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75e38ceb-ae6e-456f-968b-90e5f4f39d37", "name": "network-vif-plugged", "status": "completed", "tag": "7b71f53f-1ebd-4fef-9f3d-7b046f3f3a49"}]} {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:49:22.826305 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [req-fb23253f-48d4-4077-832c-103fe44aaae2 req-bb22d0a3-e649-4e9c-a600-896e1d4f0b86 service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:22.826785 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [req-fb23253f-48d4-4077-832c-103fe44aaae2 req-bb22d0a3-e649-4e9c-a600-896e1d4f0b86 service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:22.837634 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.compute.server_external_events [req-fb23253f-48d4-4077-832c-103fe44aaae2 req-bb22d0a3-e649-4e9c-a600-896e1d4f0b86 service nova] Creating event network-vif-plugged:7b71f53f-1ebd-4fef-9f3d-7b046f3f3a49 for instance 75e38ceb-ae6e-456f-968b-90e5f4f39d37 on hv-cinder-84497 Jun 07 14:49:22.843430 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [req-fb23253f-48d4-4077-832c-103fe44aaae2 req-bb22d0a3-e649-4e9c-a600-896e1d4f0b86 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029279 Jun 07 14:49:22.844362 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 483/958] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jun 7 14:49:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:49:23.279534 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-9a779269-482d-4b4f-abe5-5202f6592c68 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:23.280151 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-9a779269-482d-4b4f-abe5-5202f6592c68 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: 89db7091-f026-4913-962e-ad45fd38b468] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:23.290938 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-9a779269-482d-4b4f-abe5-5202f6592c68 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:23.292185 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-9a779269-482d-4b4f-abe5-5202f6592c68 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:23.293978 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-9a779269-482d-4b4f-abe5-5202f6592c68 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:23.295515 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-9a779269-482d-4b4f-abe5-5202f6592c68 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:23.507839 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-9a779269-482d-4b4f-abe5-5202f6592c68 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:23.516518 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-9a779269-482d-4b4f-abe5-5202f6592c68 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:23.518024 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-9a779269-482d-4b4f-abe5-5202f6592c68 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:23.519179 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-9a779269-482d-4b4f-abe5-5202f6592c68 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468" status: 200 len: 1727 microversion: 2.20 time: 0.244108 Jun 07 14:49:23.519729 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 476/959] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:49:23 2022] GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468 => generated 1727 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:49:23.590875 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-159acf91-81a1-449d-a581-98a11cf8542e tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:23.591611 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-159acf91-81a1-449d-a581-98a11cf8542e tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] [instance: 75e38ceb-ae6e-456f-968b-90e5f4f39d37] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:23.598130 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-159acf91-81a1-449d-a581-98a11cf8542e tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:23.598587 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-159acf91-81a1-449d-a581-98a11cf8542e tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:23.599366 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-159acf91-81a1-449d-a581-98a11cf8542e tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:23.599988 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-159acf91-81a1-449d-a581-98a11cf8542e tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:23.753795 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-159acf91-81a1-449d-a581-98a11cf8542e tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b3f5c080034b658cbfb311c0c77b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b63567b3e54cf1a4348fb65b65a040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:23.761570 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-159acf91-81a1-449d-a581-98a11cf8542e tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] 10.222.0.85 "GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37" status: 200 len: 1359 microversion: 2.1 time: 0.175789 Jun 07 14:49:23.770810 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 484/960] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:49:23 2022] GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37 => generated 1359 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:49:24.538579 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-5fe838fa-bdd7-4523-864a-63b061aef7f9 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:24.539228 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-5fe838fa-bdd7-4523-864a-63b061aef7f9 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: 89db7091-f026-4913-962e-ad45fd38b468] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:24.547345 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-5fe838fa-bdd7-4523-864a-63b061aef7f9 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:24.547805 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-5fe838fa-bdd7-4523-864a-63b061aef7f9 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:24.548678 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-5fe838fa-bdd7-4523-864a-63b061aef7f9 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:24.549101 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-5fe838fa-bdd7-4523-864a-63b061aef7f9 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:24.687491 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-5fe838fa-bdd7-4523-864a-63b061aef7f9 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:24.696243 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-5fe838fa-bdd7-4523-864a-63b061aef7f9 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:24.697911 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-5fe838fa-bdd7-4523-864a-63b061aef7f9 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:24.699405 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-5fe838fa-bdd7-4523-864a-63b061aef7f9 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468" status: 200 len: 1727 microversion: 2.20 time: 0.165297 Jun 07 14:49:24.700680 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 477/961] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:49:24 2022] GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468 => generated 1727 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:49:24.778970 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-f67d9eb7-c2f6-4e03-8dd7-11aaceda3616 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:24.781378 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-f67d9eb7-c2f6-4e03-8dd7-11aaceda3616 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] [instance: 75e38ceb-ae6e-456f-968b-90e5f4f39d37] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:24.787641 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-f67d9eb7-c2f6-4e03-8dd7-11aaceda3616 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:24.788746 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-f67d9eb7-c2f6-4e03-8dd7-11aaceda3616 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:24.789748 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-f67d9eb7-c2f6-4e03-8dd7-11aaceda3616 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:24.790184 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-f67d9eb7-c2f6-4e03-8dd7-11aaceda3616 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:24.937723 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-f67d9eb7-c2f6-4e03-8dd7-11aaceda3616 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b3f5c080034b658cbfb311c0c77b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b63567b3e54cf1a4348fb65b65a040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:24.946708 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-f67d9eb7-c2f6-4e03-8dd7-11aaceda3616 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] 10.222.0.85 "GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37" status: 200 len: 1359 microversion: 2.1 time: 0.171993 Jun 07 14:49:24.956259 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 485/962] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:49:24 2022] GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37 => generated 1359 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:49:25.719950 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-a76ee58e-1ff2-4a9a-8eb5-1b1d9e6f1f79 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:25.720601 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-a76ee58e-1ff2-4a9a-8eb5-1b1d9e6f1f79 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: 89db7091-f026-4913-962e-ad45fd38b468] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:25.727620 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-a76ee58e-1ff2-4a9a-8eb5-1b1d9e6f1f79 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:25.728076 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-a76ee58e-1ff2-4a9a-8eb5-1b1d9e6f1f79 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:25.730261 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-a76ee58e-1ff2-4a9a-8eb5-1b1d9e6f1f79 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:25.730261 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-a76ee58e-1ff2-4a9a-8eb5-1b1d9e6f1f79 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:25.875093 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-a76ee58e-1ff2-4a9a-8eb5-1b1d9e6f1f79 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:25.883179 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-a76ee58e-1ff2-4a9a-8eb5-1b1d9e6f1f79 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:25.884690 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-a76ee58e-1ff2-4a9a-8eb5-1b1d9e6f1f79 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:25.885844 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-a76ee58e-1ff2-4a9a-8eb5-1b1d9e6f1f79 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468" status: 200 len: 1727 microversion: 2.20 time: 0.169955 Jun 07 14:49:25.886379 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 478/963] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:49:25 2022] GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468 => generated 1727 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:49:25.963794 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-a6f69d92-4114-413d-96aa-cd99ae7c31d0 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:25.964850 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-a6f69d92-4114-413d-96aa-cd99ae7c31d0 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] [instance: 75e38ceb-ae6e-456f-968b-90e5f4f39d37] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:25.971907 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-a6f69d92-4114-413d-96aa-cd99ae7c31d0 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:25.972301 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-a6f69d92-4114-413d-96aa-cd99ae7c31d0 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:25.973102 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-a6f69d92-4114-413d-96aa-cd99ae7c31d0 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:25.973538 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-a6f69d92-4114-413d-96aa-cd99ae7c31d0 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:26.173796 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-a6f69d92-4114-413d-96aa-cd99ae7c31d0 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b3f5c080034b658cbfb311c0c77b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b63567b3e54cf1a4348fb65b65a040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:26.181281 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-a6f69d92-4114-413d-96aa-cd99ae7c31d0 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] 10.222.0.85 "GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37" status: 200 len: 1359 microversion: 2.1 time: 0.221612 Jun 07 14:49:26.181843 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 486/964] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:49:25 2022] GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37 => generated 1359 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:49:26.906087 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-995cde22-c2ba-4e88-96c6-0bbb23ee9343 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:26.906643 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-995cde22-c2ba-4e88-96c6-0bbb23ee9343 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: 89db7091-f026-4913-962e-ad45fd38b468] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:26.913300 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-995cde22-c2ba-4e88-96c6-0bbb23ee9343 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:26.913759 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-995cde22-c2ba-4e88-96c6-0bbb23ee9343 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:26.914536 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-995cde22-c2ba-4e88-96c6-0bbb23ee9343 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:26.914976 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-995cde22-c2ba-4e88-96c6-0bbb23ee9343 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:27.054742 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-995cde22-c2ba-4e88-96c6-0bbb23ee9343 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:27.063093 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-995cde22-c2ba-4e88-96c6-0bbb23ee9343 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:27.070407 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-995cde22-c2ba-4e88-96c6-0bbb23ee9343 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:27.070407 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-995cde22-c2ba-4e88-96c6-0bbb23ee9343 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468" status: 200 len: 1727 microversion: 2.20 time: 0.164584 Jun 07 14:49:27.070407 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 479/965] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:49:26 2022] GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468 => generated 1727 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:49:27.228847 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-79efadfe-7091-4bd1-9bc9-4652f2108f95 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:27.229444 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-79efadfe-7091-4bd1-9bc9-4652f2108f95 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] [instance: 75e38ceb-ae6e-456f-968b-90e5f4f39d37] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:27.236804 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-79efadfe-7091-4bd1-9bc9-4652f2108f95 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:27.237295 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-79efadfe-7091-4bd1-9bc9-4652f2108f95 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:27.238072 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-79efadfe-7091-4bd1-9bc9-4652f2108f95 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:27.238514 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-79efadfe-7091-4bd1-9bc9-4652f2108f95 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:27.387849 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-79efadfe-7091-4bd1-9bc9-4652f2108f95 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b3f5c080034b658cbfb311c0c77b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b63567b3e54cf1a4348fb65b65a040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:27.395637 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-79efadfe-7091-4bd1-9bc9-4652f2108f95 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] 10.222.0.85 "GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37" status: 200 len: 1359 microversion: 2.1 time: 0.170496 Jun 07 14:49:27.396215 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 487/966] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:49:27 2022] GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37 => generated 1359 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:49:28.084896 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-5b5b1644-ef8b-44be-a117-36cc03ce7f53 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:28.085517 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-5b5b1644-ef8b-44be-a117-36cc03ce7f53 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: 89db7091-f026-4913-962e-ad45fd38b468] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:28.092722 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-5b5b1644-ef8b-44be-a117-36cc03ce7f53 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:28.093181 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-5b5b1644-ef8b-44be-a117-36cc03ce7f53 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:28.093956 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-5b5b1644-ef8b-44be-a117-36cc03ce7f53 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:28.094396 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-5b5b1644-ef8b-44be-a117-36cc03ce7f53 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:28.232303 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-5b5b1644-ef8b-44be-a117-36cc03ce7f53 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:28.241072 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-5b5b1644-ef8b-44be-a117-36cc03ce7f53 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:28.242763 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-5b5b1644-ef8b-44be-a117-36cc03ce7f53 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:28.244480 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-5b5b1644-ef8b-44be-a117-36cc03ce7f53 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468" status: 200 len: 1727 microversion: 2.20 time: 0.163389 Jun 07 14:49:28.245410 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 480/967] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:49:28 2022] GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468 => generated 1727 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:49:28.412643 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-63a3a278-78a4-4afe-a851-e39c6496fbf9 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:28.413246 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-63a3a278-78a4-4afe-a851-e39c6496fbf9 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] [instance: 75e38ceb-ae6e-456f-968b-90e5f4f39d37] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:28.421113 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG dbcounter [-] [118158] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3 {{(pid=118158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:49:28.422855 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-63a3a278-78a4-4afe-a851-e39c6496fbf9 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:28.424159 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-63a3a278-78a4-4afe-a851-e39c6496fbf9 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:28.424992 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-63a3a278-78a4-4afe-a851-e39c6496fbf9 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:28.425440 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-63a3a278-78a4-4afe-a851-e39c6496fbf9 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:28.608198 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-63a3a278-78a4-4afe-a851-e39c6496fbf9 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b3f5c080034b658cbfb311c0c77b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b63567b3e54cf1a4348fb65b65a040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:28.616893 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-63a3a278-78a4-4afe-a851-e39c6496fbf9 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] 10.222.0.85 "GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37" status: 200 len: 1359 microversion: 2.1 time: 0.208088 Jun 07 14:49:28.617510 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 488/968] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:49:28 2022] GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37 => generated 1359 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:49:29.267262 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-bd4a0f98-f8ac-483a-a7a2-1df5c0dfb5d0 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:29.267839 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-bd4a0f98-f8ac-483a-a7a2-1df5c0dfb5d0 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: 89db7091-f026-4913-962e-ad45fd38b468] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:29.274307 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-bd4a0f98-f8ac-483a-a7a2-1df5c0dfb5d0 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:29.275024 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-bd4a0f98-f8ac-483a-a7a2-1df5c0dfb5d0 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:29.275791 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-bd4a0f98-f8ac-483a-a7a2-1df5c0dfb5d0 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:29.276353 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-bd4a0f98-f8ac-483a-a7a2-1df5c0dfb5d0 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:29.422479 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-bd4a0f98-f8ac-483a-a7a2-1df5c0dfb5d0 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:29.433425 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-bd4a0f98-f8ac-483a-a7a2-1df5c0dfb5d0 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:29.435963 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-bd4a0f98-f8ac-483a-a7a2-1df5c0dfb5d0 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:29.437511 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-bd4a0f98-f8ac-483a-a7a2-1df5c0dfb5d0 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468" status: 200 len: 1727 microversion: 2.20 time: 0.174259 Jun 07 14:49:29.449011 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 481/969] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:49:29 2022] GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468 => generated 1727 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:49:29.636263 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-18554171-65d2-433f-9e33-7a86c8d4261c tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:29.637007 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-18554171-65d2-433f-9e33-7a86c8d4261c tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] [instance: 75e38ceb-ae6e-456f-968b-90e5f4f39d37] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:29.644191 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-18554171-65d2-433f-9e33-7a86c8d4261c tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:29.644827 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-18554171-65d2-433f-9e33-7a86c8d4261c tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:29.645617 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-18554171-65d2-433f-9e33-7a86c8d4261c tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:29.646112 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-18554171-65d2-433f-9e33-7a86c8d4261c tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:29.809525 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-18554171-65d2-433f-9e33-7a86c8d4261c tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b3f5c080034b658cbfb311c0c77b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b63567b3e54cf1a4348fb65b65a040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:29.817973 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-18554171-65d2-433f-9e33-7a86c8d4261c tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] 10.222.0.85 "GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37" status: 200 len: 1359 microversion: 2.1 time: 0.185745 Jun 07 14:49:29.819720 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 489/970] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:49:29 2022] GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37 => generated 1359 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:49:30.458022 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-76a063c3-b544-438e-b5f7-8036d27ef8ff tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:30.458665 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-76a063c3-b544-438e-b5f7-8036d27ef8ff tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: 89db7091-f026-4913-962e-ad45fd38b468] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:30.465333 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-76a063c3-b544-438e-b5f7-8036d27ef8ff tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:30.465748 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-76a063c3-b544-438e-b5f7-8036d27ef8ff tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:30.466506 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-76a063c3-b544-438e-b5f7-8036d27ef8ff tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:30.466937 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-76a063c3-b544-438e-b5f7-8036d27ef8ff tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:30.613021 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-76a063c3-b544-438e-b5f7-8036d27ef8ff tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:30.620997 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-76a063c3-b544-438e-b5f7-8036d27ef8ff tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:30.623272 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-76a063c3-b544-438e-b5f7-8036d27ef8ff tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:30.624468 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-76a063c3-b544-438e-b5f7-8036d27ef8ff tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468" status: 200 len: 1727 microversion: 2.20 time: 0.170396 Jun 07 14:49:30.625018 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 482/971] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:49:30 2022] GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468 => generated 1727 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 14:49:30.835614 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-0458b358-1cf2-4319-8bcc-4f4aa234e29b tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:30.836348 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-0458b358-1cf2-4319-8bcc-4f4aa234e29b tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] [instance: 75e38ceb-ae6e-456f-968b-90e5f4f39d37] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:30.843761 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-0458b358-1cf2-4319-8bcc-4f4aa234e29b tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:30.843761 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-0458b358-1cf2-4319-8bcc-4f4aa234e29b tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:30.844643 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-0458b358-1cf2-4319-8bcc-4f4aa234e29b tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:30.845242 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-0458b358-1cf2-4319-8bcc-4f4aa234e29b tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:30.988490 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-0458b358-1cf2-4319-8bcc-4f4aa234e29b tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b3f5c080034b658cbfb311c0c77b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b63567b3e54cf1a4348fb65b65a040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:30.995929 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-0458b358-1cf2-4319-8bcc-4f4aa234e29b tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] 10.222.0.85 "GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37" status: 200 len: 1359 microversion: 2.1 time: 0.164404 Jun 07 14:49:30.996513 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 490/972] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:49:30 2022] GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37 => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:49:31.649107 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-0241e819-63af-407e-ac39-0514a8f3add1 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:31.649989 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-0241e819-63af-407e-ac39-0514a8f3add1 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: 89db7091-f026-4913-962e-ad45fd38b468] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:31.656635 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-0241e819-63af-407e-ac39-0514a8f3add1 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:31.657080 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-0241e819-63af-407e-ac39-0514a8f3add1 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:31.657840 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-0241e819-63af-407e-ac39-0514a8f3add1 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:31.658272 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-0241e819-63af-407e-ac39-0514a8f3add1 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:31.797431 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-0241e819-63af-407e-ac39-0514a8f3add1 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:31.805383 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-0241e819-63af-407e-ac39-0514a8f3add1 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:31.806873 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-0241e819-63af-407e-ac39-0514a8f3add1 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:31.808022 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-0241e819-63af-407e-ac39-0514a8f3add1 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468" status: 200 len: 1727 microversion: 2.20 time: 0.163477 Jun 07 14:49:31.809124 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 483/973] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:49:31 2022] GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468 => generated 1727 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:49:32.013413 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-0401b0f2-0ff2-476f-95be-8c652dbc1804 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:32.014078 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-0401b0f2-0ff2-476f-95be-8c652dbc1804 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] [instance: 75e38ceb-ae6e-456f-968b-90e5f4f39d37] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:32.021062 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-0401b0f2-0ff2-476f-95be-8c652dbc1804 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:32.021514 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-0401b0f2-0ff2-476f-95be-8c652dbc1804 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:32.022282 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-0401b0f2-0ff2-476f-95be-8c652dbc1804 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:32.022712 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-0401b0f2-0ff2-476f-95be-8c652dbc1804 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:32.166548 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-0401b0f2-0ff2-476f-95be-8c652dbc1804 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b3f5c080034b658cbfb311c0c77b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b63567b3e54cf1a4348fb65b65a040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:32.174942 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-0401b0f2-0ff2-476f-95be-8c652dbc1804 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] 10.222.0.85 "GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37" status: 200 len: 1359 microversion: 2.1 time: 0.165495 Jun 07 14:49:32.178300 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 491/974] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:49:32 2022] GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37 => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:49:32.827875 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-60827269-5ae1-4241-87ff-fc26c3d37145 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:32.828526 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-60827269-5ae1-4241-87ff-fc26c3d37145 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: 89db7091-f026-4913-962e-ad45fd38b468] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:32.835088 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-60827269-5ae1-4241-87ff-fc26c3d37145 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:32.835629 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-60827269-5ae1-4241-87ff-fc26c3d37145 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:32.836427 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-60827269-5ae1-4241-87ff-fc26c3d37145 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:32.836859 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-60827269-5ae1-4241-87ff-fc26c3d37145 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:32.989079 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-60827269-5ae1-4241-87ff-fc26c3d37145 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:32.997675 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-60827269-5ae1-4241-87ff-fc26c3d37145 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:32.999156 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-60827269-5ae1-4241-87ff-fc26c3d37145 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:33.000316 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-60827269-5ae1-4241-87ff-fc26c3d37145 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468" status: 200 len: 1727 microversion: 2.20 time: 0.176980 Jun 07 14:49:33.000914 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 484/975] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:49:32 2022] GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468 => generated 1727 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:49:33.192711 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-020ad938-0d50-4e9b-a2be-ec4c2cd14cf3 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:33.193610 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-020ad938-0d50-4e9b-a2be-ec4c2cd14cf3 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] [instance: 75e38ceb-ae6e-456f-968b-90e5f4f39d37] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:33.202320 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-020ad938-0d50-4e9b-a2be-ec4c2cd14cf3 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:33.202776 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-020ad938-0d50-4e9b-a2be-ec4c2cd14cf3 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:33.204192 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-020ad938-0d50-4e9b-a2be-ec4c2cd14cf3 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:33.204715 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-020ad938-0d50-4e9b-a2be-ec4c2cd14cf3 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:33.349366 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-020ad938-0d50-4e9b-a2be-ec4c2cd14cf3 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b3f5c080034b658cbfb311c0c77b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b63567b3e54cf1a4348fb65b65a040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:33.357615 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-020ad938-0d50-4e9b-a2be-ec4c2cd14cf3 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] 10.222.0.85 "GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37" status: 200 len: 1359 microversion: 2.1 time: 0.168772 Jun 07 14:49:33.358593 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 492/976] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:49:33 2022] GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37 => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:49:34.019121 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-5095c99c-be8d-4277-a9e6-ef52626a06e6 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:34.019766 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-5095c99c-be8d-4277-a9e6-ef52626a06e6 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: 89db7091-f026-4913-962e-ad45fd38b468] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:34.026592 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-5095c99c-be8d-4277-a9e6-ef52626a06e6 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:34.027044 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-5095c99c-be8d-4277-a9e6-ef52626a06e6 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:34.028347 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-5095c99c-be8d-4277-a9e6-ef52626a06e6 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:34.028813 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-5095c99c-be8d-4277-a9e6-ef52626a06e6 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:34.161395 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-5095c99c-be8d-4277-a9e6-ef52626a06e6 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:34.169997 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-5095c99c-be8d-4277-a9e6-ef52626a06e6 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:34.173096 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-5095c99c-be8d-4277-a9e6-ef52626a06e6 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:34.173096 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-5095c99c-be8d-4277-a9e6-ef52626a06e6 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468" status: 200 len: 1727 microversion: 2.20 time: 0.157659 Jun 07 14:49:34.173300 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 485/977] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:49:34 2022] GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468 => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:49:34.375230 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-a78396c1-ba18-4373-b40f-cebd890fc51d tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:34.375837 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-a78396c1-ba18-4373-b40f-cebd890fc51d tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] [instance: 75e38ceb-ae6e-456f-968b-90e5f4f39d37] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:34.382386 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-a78396c1-ba18-4373-b40f-cebd890fc51d tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:34.382842 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-a78396c1-ba18-4373-b40f-cebd890fc51d tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:34.383619 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-a78396c1-ba18-4373-b40f-cebd890fc51d tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:34.384065 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-a78396c1-ba18-4373-b40f-cebd890fc51d tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:34.517831 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-a78396c1-ba18-4373-b40f-cebd890fc51d tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b3f5c080034b658cbfb311c0c77b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b63567b3e54cf1a4348fb65b65a040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:34.525852 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-a78396c1-ba18-4373-b40f-cebd890fc51d tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] 10.222.0.85 "GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37" status: 200 len: 1359 microversion: 2.1 time: 0.154594 Jun 07 14:49:34.526417 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 493/978] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:49:34 2022] GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37 => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:49:35.191546 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-4080e9ae-db27-4ab5-a2d3-d8cdfe892ab1 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:35.192069 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-4080e9ae-db27-4ab5-a2d3-d8cdfe892ab1 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: 89db7091-f026-4913-962e-ad45fd38b468] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:35.198715 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-4080e9ae-db27-4ab5-a2d3-d8cdfe892ab1 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:35.199169 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-4080e9ae-db27-4ab5-a2d3-d8cdfe892ab1 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:35.200004 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-4080e9ae-db27-4ab5-a2d3-d8cdfe892ab1 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:35.200484 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-4080e9ae-db27-4ab5-a2d3-d8cdfe892ab1 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:35.336303 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-4080e9ae-db27-4ab5-a2d3-d8cdfe892ab1 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:35.344409 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-4080e9ae-db27-4ab5-a2d3-d8cdfe892ab1 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:35.345979 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-4080e9ae-db27-4ab5-a2d3-d8cdfe892ab1 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:35.347144 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-4080e9ae-db27-4ab5-a2d3-d8cdfe892ab1 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468" status: 200 len: 1727 microversion: 2.20 time: 0.159608 Jun 07 14:49:35.347699 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 486/979] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:49:35 2022] GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468 => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 14:49:35.543754 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-2b051211-82f0-4d93-b637-b327c11eea86 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:35.544402 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-2b051211-82f0-4d93-b637-b327c11eea86 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] [instance: 75e38ceb-ae6e-456f-968b-90e5f4f39d37] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:35.551165 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-2b051211-82f0-4d93-b637-b327c11eea86 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:35.551618 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-2b051211-82f0-4d93-b637-b327c11eea86 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:35.552414 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-2b051211-82f0-4d93-b637-b327c11eea86 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:35.552859 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-2b051211-82f0-4d93-b637-b327c11eea86 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:35.691472 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-2b051211-82f0-4d93-b637-b327c11eea86 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b3f5c080034b658cbfb311c0c77b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b63567b3e54cf1a4348fb65b65a040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:35.698903 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-2b051211-82f0-4d93-b637-b327c11eea86 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] 10.222.0.85 "GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37" status: 200 len: 1359 microversion: 2.1 time: 0.159642 Jun 07 14:49:35.699465 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 494/980] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:49:35 2022] GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37 => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:49:36.370097 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-c5eeaab7-ec32-43e4-88ea-47c9fc8bfe12 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:36.372005 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-c5eeaab7-ec32-43e4-88ea-47c9fc8bfe12 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: 89db7091-f026-4913-962e-ad45fd38b468] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:36.378407 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-c5eeaab7-ec32-43e4-88ea-47c9fc8bfe12 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:36.378867 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-c5eeaab7-ec32-43e4-88ea-47c9fc8bfe12 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:36.383597 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-c5eeaab7-ec32-43e4-88ea-47c9fc8bfe12 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:36.383597 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-c5eeaab7-ec32-43e4-88ea-47c9fc8bfe12 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:36.542222 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-c5eeaab7-ec32-43e4-88ea-47c9fc8bfe12 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:36.550793 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-c5eeaab7-ec32-43e4-88ea-47c9fc8bfe12 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:36.552461 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-c5eeaab7-ec32-43e4-88ea-47c9fc8bfe12 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:36.553628 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-c5eeaab7-ec32-43e4-88ea-47c9fc8bfe12 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468" status: 200 len: 1727 microversion: 2.20 time: 0.189524 Jun 07 14:49:36.554210 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 487/981] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:49:36 2022] GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468 => generated 1727 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:49:36.715175 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-c90cb7c2-e7e0-481b-b7f9-af24766166b5 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:36.715772 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-c90cb7c2-e7e0-481b-b7f9-af24766166b5 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] [instance: 75e38ceb-ae6e-456f-968b-90e5f4f39d37] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:36.722329 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-c90cb7c2-e7e0-481b-b7f9-af24766166b5 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:36.722773 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-c90cb7c2-e7e0-481b-b7f9-af24766166b5 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:36.723532 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-c90cb7c2-e7e0-481b-b7f9-af24766166b5 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:36.723962 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-c90cb7c2-e7e0-481b-b7f9-af24766166b5 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:36.875888 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-c90cb7c2-e7e0-481b-b7f9-af24766166b5 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b3f5c080034b658cbfb311c0c77b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b63567b3e54cf1a4348fb65b65a040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:36.883642 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-c90cb7c2-e7e0-481b-b7f9-af24766166b5 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] 10.222.0.85 "GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37" status: 200 len: 1359 microversion: 2.1 time: 0.172348 Jun 07 14:49:36.884219 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 495/982] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:49:36 2022] GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37 => generated 1359 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:49:37.573243 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-c2ba8006-4ab2-4725-823f-b1ea21c38780 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:37.573861 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-c2ba8006-4ab2-4725-823f-b1ea21c38780 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: 89db7091-f026-4913-962e-ad45fd38b468] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:37.580540 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-c2ba8006-4ab2-4725-823f-b1ea21c38780 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:37.580993 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-c2ba8006-4ab2-4725-823f-b1ea21c38780 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:37.581762 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-c2ba8006-4ab2-4725-823f-b1ea21c38780 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:37.582200 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-c2ba8006-4ab2-4725-823f-b1ea21c38780 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:37.722686 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-c2ba8006-4ab2-4725-823f-b1ea21c38780 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:37.731643 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-c2ba8006-4ab2-4725-823f-b1ea21c38780 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:37.733175 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-c2ba8006-4ab2-4725-823f-b1ea21c38780 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:37.734414 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-c2ba8006-4ab2-4725-823f-b1ea21c38780 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468" status: 200 len: 1727 microversion: 2.20 time: 0.165127 Jun 07 14:49:37.734961 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 488/983] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:49:37 2022] GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468 => generated 1727 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:49:37.900171 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-59831e00-1ea0-4b29-b135-12d76eb3e6a3 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:37.900812 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-59831e00-1ea0-4b29-b135-12d76eb3e6a3 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] [instance: 75e38ceb-ae6e-456f-968b-90e5f4f39d37] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:37.907683 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-59831e00-1ea0-4b29-b135-12d76eb3e6a3 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:37.910868 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-59831e00-1ea0-4b29-b135-12d76eb3e6a3 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:37.910868 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-59831e00-1ea0-4b29-b135-12d76eb3e6a3 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:37.910868 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-59831e00-1ea0-4b29-b135-12d76eb3e6a3 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:38.046567 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-59831e00-1ea0-4b29-b135-12d76eb3e6a3 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b3f5c080034b658cbfb311c0c77b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b63567b3e54cf1a4348fb65b65a040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:38.053981 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-59831e00-1ea0-4b29-b135-12d76eb3e6a3 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] 10.222.0.85 "GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37" status: 200 len: 1359 microversion: 2.1 time: 0.157965 Jun 07 14:49:38.054544 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 496/984] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:49:37 2022] GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37 => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:49:38.753682 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-d828bde7-186c-4f14-a4c1-6accc314d0fd tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:38.754264 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-d828bde7-186c-4f14-a4c1-6accc314d0fd tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: 89db7091-f026-4913-962e-ad45fd38b468] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:38.760332 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-d828bde7-186c-4f14-a4c1-6accc314d0fd tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:38.760806 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-d828bde7-186c-4f14-a4c1-6accc314d0fd tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:38.761552 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-d828bde7-186c-4f14-a4c1-6accc314d0fd tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:38.762163 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-d828bde7-186c-4f14-a4c1-6accc314d0fd tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:38.902366 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-d828bde7-186c-4f14-a4c1-6accc314d0fd tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:38.911356 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-d828bde7-186c-4f14-a4c1-6accc314d0fd tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:38.913040 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-d828bde7-186c-4f14-a4c1-6accc314d0fd tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:38.914293 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-d828bde7-186c-4f14-a4c1-6accc314d0fd tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468" status: 200 len: 1727 microversion: 2.20 time: 0.164679 Jun 07 14:49:38.914838 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 489/985] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:49:38 2022] GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468 => generated 1727 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:49:39.070534 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-c6b97ff1-a177-4720-98de-e9dc3e7093f7 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:39.071158 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-c6b97ff1-a177-4720-98de-e9dc3e7093f7 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] [instance: 75e38ceb-ae6e-456f-968b-90e5f4f39d37] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:39.077592 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-c6b97ff1-a177-4720-98de-e9dc3e7093f7 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:39.078040 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-c6b97ff1-a177-4720-98de-e9dc3e7093f7 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:39.078802 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-c6b97ff1-a177-4720-98de-e9dc3e7093f7 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:39.079236 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-c6b97ff1-a177-4720-98de-e9dc3e7093f7 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:39.212628 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-c6b97ff1-a177-4720-98de-e9dc3e7093f7 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b3f5c080034b658cbfb311c0c77b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b63567b3e54cf1a4348fb65b65a040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:39.220719 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-c6b97ff1-a177-4720-98de-e9dc3e7093f7 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] 10.222.0.85 "GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37" status: 200 len: 1359 microversion: 2.1 time: 0.153939 Jun 07 14:49:39.221284 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 497/986] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:49:39 2022] GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37 => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:49:39.933140 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-bde29696-6290-4ad1-9f34-e28089ed93d8 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:39.934304 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-bde29696-6290-4ad1-9f34-e28089ed93d8 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: 89db7091-f026-4913-962e-ad45fd38b468] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:39.940914 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-bde29696-6290-4ad1-9f34-e28089ed93d8 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:39.941390 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-bde29696-6290-4ad1-9f34-e28089ed93d8 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:39.942149 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-bde29696-6290-4ad1-9f34-e28089ed93d8 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:39.942568 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-bde29696-6290-4ad1-9f34-e28089ed93d8 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:39.946664 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG dbcounter [-] [118157] Writing DB stats nova_cell1:SELECT=100 {{(pid=118157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:49:40.073035 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-bde29696-6290-4ad1-9f34-e28089ed93d8 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:40.082079 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-bde29696-6290-4ad1-9f34-e28089ed93d8 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:40.083582 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-bde29696-6290-4ad1-9f34-e28089ed93d8 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:40.084768 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-bde29696-6290-4ad1-9f34-e28089ed93d8 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468" status: 200 len: 1727 microversion: 2.20 time: 0.155560 Jun 07 14:49:40.085307 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 490/987] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:49:39 2022] GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:49:40.237556 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-5fd4d4f5-1f7a-4fef-9cad-334768203ad6 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:40.238167 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-5fd4d4f5-1f7a-4fef-9cad-334768203ad6 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] [instance: 75e38ceb-ae6e-456f-968b-90e5f4f39d37] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:40.244833 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5fd4d4f5-1f7a-4fef-9cad-334768203ad6 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:40.245282 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5fd4d4f5-1f7a-4fef-9cad-334768203ad6 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:40.246646 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5fd4d4f5-1f7a-4fef-9cad-334768203ad6 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:40.247093 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5fd4d4f5-1f7a-4fef-9cad-334768203ad6 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:40.266441 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG dbcounter [-] [118158] Writing DB stats nova_cell1:SELECT=100 {{(pid=118158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:49:40.384004 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-5fd4d4f5-1f7a-4fef-9cad-334768203ad6 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b3f5c080034b658cbfb311c0c77b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b63567b3e54cf1a4348fb65b65a040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:40.391570 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-5fd4d4f5-1f7a-4fef-9cad-334768203ad6 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] 10.222.0.85 "GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37" status: 200 len: 1359 microversion: 2.1 time: 0.157986 Jun 07 14:49:40.392128 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 498/988] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:49:40 2022] GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37 => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:49:41.103056 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-d090b593-ae23-4b77-8fcb-599f5366c45f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:41.103786 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-d090b593-ae23-4b77-8fcb-599f5366c45f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: 89db7091-f026-4913-962e-ad45fd38b468] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:41.110946 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-d090b593-ae23-4b77-8fcb-599f5366c45f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:41.111370 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-d090b593-ae23-4b77-8fcb-599f5366c45f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:41.112106 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-d090b593-ae23-4b77-8fcb-599f5366c45f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:41.112608 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-d090b593-ae23-4b77-8fcb-599f5366c45f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:41.201717 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-821de8cb-1220-498a-9afa-5f1a4c65d0c4 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:41.202714 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-821de8cb-1220-498a-9afa-5f1a4c65d0c4 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e038fb54-192d-4af5-a273-955b1493d4b4] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:41.208873 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-821de8cb-1220-498a-9afa-5f1a4c65d0c4 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:41.209324 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-821de8cb-1220-498a-9afa-5f1a4c65d0c4 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:41.210103 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-821de8cb-1220-498a-9afa-5f1a4c65d0c4 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:41.210543 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-821de8cb-1220-498a-9afa-5f1a4c65d0c4 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:41.240447 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-821de8cb-1220-498a-9afa-5f1a4c65d0c4 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e038fb54-192d-4af5-a273-955b1493d4b4/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043128 Jun 07 14:49:41.241095 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 499/989] 10.222.0.85 () {58 vars in 1301 bytes} [Tue Jun 7 14:49:41 2022] GET /compute/v2.1/servers/e038fb54-192d-4af5-a273-955b1493d4b4/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 14:49:41.248706 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-d090b593-ae23-4b77-8fcb-599f5366c45f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:41.257059 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-d090b593-ae23-4b77-8fcb-599f5366c45f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:41.258577 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-d090b593-ae23-4b77-8fcb-599f5366c45f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:41.259742 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-d090b593-ae23-4b77-8fcb-599f5366c45f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468" status: 200 len: 1727 microversion: 2.20 time: 0.160550 Jun 07 14:49:41.260293 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 491/990] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:49:41 2022] GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468 => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:49:41.379572 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-a84ebc23-4a8f-4496-b414-692a959811b2 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:41.380086 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-a84ebc23-4a8f-4496-b414-692a959811b2 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e038fb54-192d-4af5-a273-955b1493d4b4] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:41.386553 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-a84ebc23-4a8f-4496-b414-692a959811b2 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:41.387653 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-a84ebc23-4a8f-4496-b414-692a959811b2 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:41.388448 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-a84ebc23-4a8f-4496-b414-692a959811b2 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:41.388888 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-a84ebc23-4a8f-4496-b414-692a959811b2 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:41.407621 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-31c384f6-728b-4e87-8d0d-fee6d1d2d70c tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:41.408244 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-31c384f6-728b-4e87-8d0d-fee6d1d2d70c tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] [instance: 75e38ceb-ae6e-456f-968b-90e5f4f39d37] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:41.414458 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-31c384f6-728b-4e87-8d0d-fee6d1d2d70c tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:41.414914 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-31c384f6-728b-4e87-8d0d-fee6d1d2d70c tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:41.415685 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-31c384f6-728b-4e87-8d0d-fee6d1d2d70c tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:41.416128 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-31c384f6-728b-4e87-8d0d-fee6d1d2d70c tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:41.417599 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-a84ebc23-4a8f-4496-b414-692a959811b2 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e038fb54-192d-4af5-a273-955b1493d4b4/os-volume_attachments/d005f9f8-ff50-4e2b-8940-0a4b2d313083" status: 200 len: 194 microversion: 2.1 time: 0.042094 Jun 07 14:49:41.420181 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 500/991] 10.222.0.85 () {58 vars in 1412 bytes} [Tue Jun 7 14:49:41 2022] GET /compute/v2.1/servers/e038fb54-192d-4af5-a273-955b1493d4b4/os-volume_attachments/d005f9f8-ff50-4e2b-8940-0a4b2d313083 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:49:41.429371 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-5edc826b-d0f7-42c5-9cca-f36e8b57df43 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:41.429868 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-5edc826b-d0f7-42c5-9cca-f36e8b57df43 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e038fb54-192d-4af5-a273-955b1493d4b4] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:41.439245 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5edc826b-d0f7-42c5-9cca-f36e8b57df43 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:41.439701 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5edc826b-d0f7-42c5-9cca-f36e8b57df43 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:41.440501 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5edc826b-d0f7-42c5-9cca-f36e8b57df43 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:41.440938 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5edc826b-d0f7-42c5-9cca-f36e8b57df43 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:41.525804 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.objects.instance [None req-5edc826b-d0f7-42c5-9cca-f36e8b57df43 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lazy-loading 'services' on Instance uuid e038fb54-192d-4af5-a273-955b1493d4b4 {{(pid=118158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 14:49:41.554475 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-31c384f6-728b-4e87-8d0d-fee6d1d2d70c tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b3f5c080034b658cbfb311c0c77b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b63567b3e54cf1a4348fb65b65a040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:41.562429 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-31c384f6-728b-4e87-8d0d-fee6d1d2d70c tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] 10.222.0.85 "GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37" status: 200 len: 1359 microversion: 2.1 time: 0.158610 Jun 07 14:49:41.562990 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 492/992] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:49:41 2022] GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37 => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:49:41.750997 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-5edc826b-d0f7-42c5-9cca-f36e8b57df43 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "DELETE /compute/v2.1/servers/e038fb54-192d-4af5-a273-955b1493d4b4/os-volume_attachments/d005f9f8-ff50-4e2b-8940-0a4b2d313083" status: 202 len: 0 microversion: 2.1 time: 0.325109 Jun 07 14:49:41.751479 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 501/993] 10.222.0.85 () {58 vars in 1415 bytes} [Tue Jun 7 14:49:41 2022] DELETE /compute/v2.1/servers/e038fb54-192d-4af5-a273-955b1493d4b4/os-volume_attachments/d005f9f8-ff50-4e2b-8940-0a4b2d313083 => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 07 14:49:42.280350 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-5665674a-6710-4650-951b-7571969773c8 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:42.280992 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-5665674a-6710-4650-951b-7571969773c8 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: 89db7091-f026-4913-962e-ad45fd38b468] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:42.287653 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-5665674a-6710-4650-951b-7571969773c8 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:42.288103 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-5665674a-6710-4650-951b-7571969773c8 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:42.288904 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-5665674a-6710-4650-951b-7571969773c8 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:42.289348 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-5665674a-6710-4650-951b-7571969773c8 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:42.417111 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-5665674a-6710-4650-951b-7571969773c8 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:42.424966 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-5665674a-6710-4650-951b-7571969773c8 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:42.426444 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-5665674a-6710-4650-951b-7571969773c8 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:42.427578 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-5665674a-6710-4650-951b-7571969773c8 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468" status: 200 len: 1727 microversion: 2.20 time: 0.152199 Jun 07 14:49:42.428125 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 493/994] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:49:42 2022] GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:49:42.580078 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-a5c8edab-72ea-40af-be71-5a75d439e009 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:42.580724 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-a5c8edab-72ea-40af-be71-5a75d439e009 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] [instance: 75e38ceb-ae6e-456f-968b-90e5f4f39d37] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:42.587008 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-a5c8edab-72ea-40af-be71-5a75d439e009 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:42.587460 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-a5c8edab-72ea-40af-be71-5a75d439e009 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:42.588223 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-a5c8edab-72ea-40af-be71-5a75d439e009 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:42.588751 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-a5c8edab-72ea-40af-be71-5a75d439e009 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:42.733427 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-a5c8edab-72ea-40af-be71-5a75d439e009 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b3f5c080034b658cbfb311c0c77b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b63567b3e54cf1a4348fb65b65a040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:42.741141 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-a5c8edab-72ea-40af-be71-5a75d439e009 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] 10.222.0.85 "GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37" status: 200 len: 1550 microversion: 2.1 time: 0.165779 Jun 07 14:49:42.741707 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 502/995] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:49:42 2022] GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37 => generated 1550 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:49:42.757778 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-8393bc23-7527-4116-927d-ab3b352d9259 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:42.758473 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-8393bc23-7527-4116-927d-ab3b352d9259 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] [instance: 75e38ceb-ae6e-456f-968b-90e5f4f39d37] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:42.764758 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-8393bc23-7527-4116-927d-ab3b352d9259 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:42.765212 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-8393bc23-7527-4116-927d-ab3b352d9259 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:42.766052 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-8393bc23-7527-4116-927d-ab3b352d9259 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:42.766517 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-8393bc23-7527-4116-927d-ab3b352d9259 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:42.900158 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-8393bc23-7527-4116-927d-ab3b352d9259 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b3f5c080034b658cbfb311c0c77b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b63567b3e54cf1a4348fb65b65a040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:42.908542 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-8393bc23-7527-4116-927d-ab3b352d9259 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] 10.222.0.85 "GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37" status: 200 len: 1550 microversion: 2.1 time: 0.154612 Jun 07 14:49:42.909482 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 494/996] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:49:42 2022] GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37 => generated 1550 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:49:42.924739 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-95878963-ce59-4ebc-b155-9b81002be437 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:42.928167 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-95878963-ce59-4ebc-b155-9b81002be437 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f2b3f5c080034b658cbfb311c0c77b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b63567b3e54cf1a4348fb65b65a040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:42.928998 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-95878963-ce59-4ebc-b155-9b81002be437 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Searching by: {'deleted': False, 'project_id': '70b63567b3e54cf1a4348fb65b65a040'} {{(pid=118158) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 07 14:49:42.935970 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-95878963-ce59-4ebc-b155-9b81002be437 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:42.936452 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-95878963-ce59-4ebc-b155-9b81002be437 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:42.938142 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-95878963-ce59-4ebc-b155-9b81002be437 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:42.938142 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-95878963-ce59-4ebc-b155-9b81002be437 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:43.028925 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.multi_cell_list [None req-95878963-ce59-4ebc-b155-9b81002be437 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118158) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 07 14:49:43.129211 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-95878963-ce59-4ebc-b155-9b81002be437 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] 10.222.0.85 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.208111 Jun 07 14:49:43.129800 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 503/997] 10.222.0.85 () {58 vars in 1124 bytes} [Tue Jun 7 14:49:42 2022] GET /compute/v2.1/servers => generated 343 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:49:43.140888 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-13033886-9202-4a78-96c1-6da197ed8364 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:43.141609 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-13033886-9202-4a78-96c1-6da197ed8364 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] [instance: 75e38ceb-ae6e-456f-968b-90e5f4f39d37] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:43.147949 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-13033886-9202-4a78-96c1-6da197ed8364 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:43.148537 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-13033886-9202-4a78-96c1-6da197ed8364 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:43.149547 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-13033886-9202-4a78-96c1-6da197ed8364 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:43.150247 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-13033886-9202-4a78-96c1-6da197ed8364 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:43.201691 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [req-cba8afdd-b435-4926-a558-6443e7194364 req-61fd2bf8-c901-4b2b-8875-85f77c51275a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89db7091-f026-4913-962e-ad45fd38b468", "name": "network-vif-plugged", "status": "completed", "tag": "cf25b5fc-6d60-40d5-8461-593838e20baf"}]} {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:49:43.210017 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [req-cba8afdd-b435-4926-a558-6443e7194364 req-61fd2bf8-c901-4b2b-8875-85f77c51275a service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:43.210535 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [req-cba8afdd-b435-4926-a558-6443e7194364 req-61fd2bf8-c901-4b2b-8875-85f77c51275a service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:43.222690 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.compute.server_external_events [req-cba8afdd-b435-4926-a558-6443e7194364 req-61fd2bf8-c901-4b2b-8875-85f77c51275a service nova] Creating event network-vif-plugged:cf25b5fc-6d60-40d5-8461-593838e20baf for instance 89db7091-f026-4913-962e-ad45fd38b468 on hv-cinder-84497 Jun 07 14:49:43.227611 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [req-cba8afdd-b435-4926-a558-6443e7194364 req-61fd2bf8-c901-4b2b-8875-85f77c51275a service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030099 Jun 07 14:49:43.228591 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 504/998] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jun 7 14:49:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 14:49:43.284102 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-13033886-9202-4a78-96c1-6da197ed8364 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b3f5c080034b658cbfb311c0c77b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b63567b3e54cf1a4348fb65b65a040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:43.292970 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-13033886-9202-4a78-96c1-6da197ed8364 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] 10.222.0.85 "GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37" status: 200 len: 1550 microversion: 2.1 time: 0.156372 Jun 07 14:49:43.293584 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 495/999] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:49:43 2022] GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37 => generated 1550 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:49:43.447790 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-48bce501-eef0-4f0a-9cf9-c2132656782d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:43.448510 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-48bce501-eef0-4f0a-9cf9-c2132656782d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: 89db7091-f026-4913-962e-ad45fd38b468] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:43.455870 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-48bce501-eef0-4f0a-9cf9-c2132656782d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:43.456557 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-48bce501-eef0-4f0a-9cf9-c2132656782d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:43.457422 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-48bce501-eef0-4f0a-9cf9-c2132656782d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:43.458177 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-48bce501-eef0-4f0a-9cf9-c2132656782d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:43.598223 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-48bce501-eef0-4f0a-9cf9-c2132656782d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:43.607468 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-48bce501-eef0-4f0a-9cf9-c2132656782d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:43.609014 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-48bce501-eef0-4f0a-9cf9-c2132656782d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:43.610423 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-48bce501-eef0-4f0a-9cf9-c2132656782d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468" status: 200 len: 1727 microversion: 2.20 time: 0.166816 Jun 07 14:49:43.611113 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 505/1000] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:49:43 2022] GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468 => generated 1727 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:49:43.920629 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-34a13ce9-4a75-4798-aa20-12acf8a74347 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:43.921167 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-34a13ce9-4a75-4798-aa20-12acf8a74347 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e038fb54-192d-4af5-a273-955b1493d4b4] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:43.927203 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-34a13ce9-4a75-4798-aa20-12acf8a74347 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:43.927653 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-34a13ce9-4a75-4798-aa20-12acf8a74347 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:43.928446 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-34a13ce9-4a75-4798-aa20-12acf8a74347 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:43.928883 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-34a13ce9-4a75-4798-aa20-12acf8a74347 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:43.960542 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-34a13ce9-4a75-4798-aa20-12acf8a74347 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e038fb54-192d-4af5-a273-955b1493d4b4/os-volume_attachments/8c114450-27fc-433c-9984-54219ce344d7" status: 200 len: 194 microversion: 2.1 time: 0.043313 Jun 07 14:49:43.960542 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 496/1001] 10.222.0.85 () {58 vars in 1412 bytes} [Tue Jun 7 14:49:43 2022] GET /compute/v2.1/servers/e038fb54-192d-4af5-a273-955b1493d4b4/os-volume_attachments/8c114450-27fc-433c-9984-54219ce344d7 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:49:43.972049 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-89e3cf99-9e00-47ec-8264-bb4e56a026b3 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:43.977299 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-89e3cf99-9e00-47ec-8264-bb4e56a026b3 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e038fb54-192d-4af5-a273-955b1493d4b4] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:43.979760 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-89e3cf99-9e00-47ec-8264-bb4e56a026b3 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:43.980286 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-89e3cf99-9e00-47ec-8264-bb4e56a026b3 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:43.981729 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-89e3cf99-9e00-47ec-8264-bb4e56a026b3 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:43.982319 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-89e3cf99-9e00-47ec-8264-bb4e56a026b3 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:44.081580 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.objects.instance [None req-89e3cf99-9e00-47ec-8264-bb4e56a026b3 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lazy-loading 'services' on Instance uuid e038fb54-192d-4af5-a273-955b1493d4b4 {{(pid=118158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 14:49:44.166585 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-7f72da38-7090-4bca-990f-1f1296a85bcf tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-253510395", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1252179120", "security_groups": [{"name": "tempest-secgroup-smoke-1421120797"}], "block_device_mapping_v2": [{"uuid": "868f48d0-5541-446e-a7cd-c52be03f5a7e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b46e8eee-36c4-4173-8e97-a52c3b403e49"}]}} {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:49:44.280230 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.network.neutron [None req-7f72da38-7090-4bca-990f-1f1296a85bcf tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] validate_networks() for [('b46e8eee-36c4-4173-8e97-a52c3b403e49', None, None, None, None, None)] {{(pid=118157) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 14:49:44.333319 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-89e3cf99-9e00-47ec-8264-bb4e56a026b3 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "DELETE /compute/v2.1/servers/e038fb54-192d-4af5-a273-955b1493d4b4/os-volume_attachments/8c114450-27fc-433c-9984-54219ce344d7" status: 202 len: 0 microversion: 2.1 time: 0.365473 Jun 07 14:49:44.333945 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 506/1002] 10.222.0.85 () {58 vars in 1415 bytes} [Tue Jun 7 14:49:43 2022] DELETE /compute/v2.1/servers/e038fb54-192d-4af5-a273-955b1493d4b4/os-volume_attachments/8c114450-27fc-433c-9984-54219ce344d7 => generated 0 bytes in 367 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 14:49:44.633962 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-f6fa7b12-5930-446c-baae-de8cf7e001c5 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:44.634597 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-f6fa7b12-5930-446c-baae-de8cf7e001c5 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: 89db7091-f026-4913-962e-ad45fd38b468] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:44.641207 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-f6fa7b12-5930-446c-baae-de8cf7e001c5 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:44.641207 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-f6fa7b12-5930-446c-baae-de8cf7e001c5 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:44.641999 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-f6fa7b12-5930-446c-baae-de8cf7e001c5 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:44.642435 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-f6fa7b12-5930-446c-baae-de8cf7e001c5 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:44.715920 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.virt.hardware [None req-7f72da38-7090-4bca-990f-1f1296a85bcf tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Flavor limits 0:0:0 {{(pid=118157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 14:49:44.716717 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.virt.hardware [None req-7f72da38-7090-4bca-990f-1f1296a85bcf tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Image limits 0:0:0 {{(pid=118157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 14:49:44.717194 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.virt.hardware [None req-7f72da38-7090-4bca-990f-1f1296a85bcf tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Flavor pref 0:0:0 {{(pid=118157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 14:49:44.717601 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.virt.hardware [None req-7f72da38-7090-4bca-990f-1f1296a85bcf tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Image pref 0:0:0 {{(pid=118157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 14:49:44.718042 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.virt.hardware [None req-7f72da38-7090-4bca-990f-1f1296a85bcf tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 14:49:44.732575 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-7f72da38-7090-4bca-990f-1f1296a85bcf tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:44.733073 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-7f72da38-7090-4bca-990f-1f1296a85bcf tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:44.733886 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-7f72da38-7090-4bca-990f-1f1296a85bcf tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:44.734324 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-7f72da38-7090-4bca-990f-1f1296a85bcf tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:44.752415 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.quota [None req-7f72da38-7090-4bca-990f-1f1296a85bcf tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Getting quotas for project 93e877695d0f46339cb4b9b86aac3662. Resources: {'instances', 'cores', 'ram'} {{(pid=118157) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 14:49:44.756605 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.quota [None req-7f72da38-7090-4bca-990f-1f1296a85bcf tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Getting quotas for user 0a15f5fa82414bdf8ca3f6723c0a8d2d and project 93e877695d0f46339cb4b9b86aac3662. Resources: {'instances', 'cores', 'ram'} {{(pid=118157) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 14:49:44.796210 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-f6fa7b12-5930-446c-baae-de8cf7e001c5 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:44.804621 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-f6fa7b12-5930-446c-baae-de8cf7e001c5 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:44.806239 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-f6fa7b12-5930-446c-baae-de8cf7e001c5 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:44.807629 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-f6fa7b12-5930-446c-baae-de8cf7e001c5 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468" status: 200 len: 1727 microversion: 2.20 time: 0.178632 Jun 07 14:49:44.808407 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 507/1003] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:49:44 2022] GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468 => generated 1727 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:49:44.824851 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-7f72da38-7090-4bca-990f-1f1296a85bcf tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Going to run 1 instances... {{(pid=118157) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 14:49:44.827749 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-7f72da38-7090-4bca-990f-1f1296a85bcf tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: 7bae9245-118c-4121-b43a-307dd6046a75] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='868f48d0-5541-446e-a7cd-c52be03f5a7e',volume_size=None,volume_type=None)] {{(pid=118157) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 14:49:45.229125 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-13cf0a54-5c66-4d40-9bec-9b065970c6c3 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "337782ec-525e-4e04-8c45-7fd8bfa4173b"}} {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:49:45.229125 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-13cf0a54-5c66-4d40-9bec-9b065970c6c3 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] [instance: 75e38ceb-ae6e-456f-968b-90e5f4f39d37] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:45.230704 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-13cf0a54-5c66-4d40-9bec-9b065970c6c3 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:45.231152 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-13cf0a54-5c66-4d40-9bec-9b065970c6c3 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:45.231918 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-13cf0a54-5c66-4d40-9bec-9b065970c6c3 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:45.232353 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-13cf0a54-5c66-4d40-9bec-9b065970c6c3 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:45.293147 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-7f72da38-7090-4bca-990f-1f1296a85bcf tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.130476 Jun 07 14:49:45.293782 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 497/1004] 10.222.0.85 () {60 vars in 1146 bytes} [Tue Jun 7 14:49:44 2022] POST /compute/v2.1/servers => generated 406 bytes in 1132 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 07 14:49:45.303342 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-12f4399b-cf92-4d33-9220-227f06cb7e1e tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:45.303956 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-12f4399b-cf92-4d33-9220-227f06cb7e1e tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: 7bae9245-118c-4121-b43a-307dd6046a75] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:45.369533 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-12f4399b-cf92-4d33-9220-227f06cb7e1e tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15f5fa82414bdf8ca3f6723c0a8d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e877695d0f46339cb4b9b86aac3662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:45.378830 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-12f4399b-cf92-4d33-9220-227f06cb7e1e tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "GET /compute/v2.1/servers/7bae9245-118c-4121-b43a-307dd6046a75" status: 200 len: 1094 microversion: 2.1 time: 0.079144 Jun 07 14:49:45.380222 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 498/1005] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:49:45 2022] GET /compute/v2.1/servers/7bae9245-118c-4121-b43a-307dd6046a75 => generated 1094 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:49:45.826597 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-162ebcc1-9c80-42d3-96d1-9e0c27568e9a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:45.827237 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-162ebcc1-9c80-42d3-96d1-9e0c27568e9a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: 89db7091-f026-4913-962e-ad45fd38b468] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:45.833240 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-162ebcc1-9c80-42d3-96d1-9e0c27568e9a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:45.833693 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-162ebcc1-9c80-42d3-96d1-9e0c27568e9a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:45.834473 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-162ebcc1-9c80-42d3-96d1-9e0c27568e9a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:45.834905 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-162ebcc1-9c80-42d3-96d1-9e0c27568e9a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:45.991909 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-162ebcc1-9c80-42d3-96d1-9e0c27568e9a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:46.001389 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-162ebcc1-9c80-42d3-96d1-9e0c27568e9a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:46.002900 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-162ebcc1-9c80-42d3-96d1-9e0c27568e9a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:46.004055 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-162ebcc1-9c80-42d3-96d1-9e0c27568e9a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468" status: 200 len: 1727 microversion: 2.20 time: 0.181882 Jun 07 14:49:46.004635 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 499/1006] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:49:45 2022] GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468 => generated 1727 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 14:49:46.397215 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-37570d04-5a24-4a37-9991-fcab7b1edb11 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:46.397829 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-37570d04-5a24-4a37-9991-fcab7b1edb11 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: 7bae9245-118c-4121-b43a-307dd6046a75] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:46.405975 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-37570d04-5a24-4a37-9991-fcab7b1edb11 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:46.406695 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-37570d04-5a24-4a37-9991-fcab7b1edb11 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:46.407644 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-37570d04-5a24-4a37-9991-fcab7b1edb11 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:46.408254 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-37570d04-5a24-4a37-9991-fcab7b1edb11 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:46.475601 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-37570d04-5a24-4a37-9991-fcab7b1edb11 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15f5fa82414bdf8ca3f6723c0a8d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e877695d0f46339cb4b9b86aac3662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:46.485741 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-37570d04-5a24-4a37-9991-fcab7b1edb11 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "GET /compute/v2.1/servers/7bae9245-118c-4121-b43a-307dd6046a75" status: 200 len: 1144 microversion: 2.1 time: 0.091668 Jun 07 14:49:46.486826 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 500/1007] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:49:46 2022] GET /compute/v2.1/servers/7bae9245-118c-4121-b43a-307dd6046a75 => generated 1144 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:49:46.517395 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-13cf0a54-5c66-4d40-9bec-9b065970c6c3 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] 10.222.0.85 "POST /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.297921 Jun 07 14:49:46.525750 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 508/1008] 10.222.0.85 () {60 vars in 1322 bytes} [Tue Jun 7 14:49:45 2022] POST /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37/os-volume_attachments => generated 194 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 14:49:46.586719 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-1400ada2-3bb2-4207-8599-48eb7dc4775c tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:46.587732 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-1400ada2-3bb2-4207-8599-48eb7dc4775c tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e038fb54-192d-4af5-a273-955b1493d4b4] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:46.594887 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-1400ada2-3bb2-4207-8599-48eb7dc4775c tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:46.595491 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-1400ada2-3bb2-4207-8599-48eb7dc4775c tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:46.596266 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-1400ada2-3bb2-4207-8599-48eb7dc4775c tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:46.596766 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-1400ada2-3bb2-4207-8599-48eb7dc4775c tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:46.628617 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-1400ada2-3bb2-4207-8599-48eb7dc4775c tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e038fb54-192d-4af5-a273-955b1493d4b4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046081 Jun 07 14:49:46.629265 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 501/1009] 10.222.0.85 () {58 vars in 1301 bytes} [Tue Jun 7 14:49:46 2022] GET /compute/v2.1/servers/e038fb54-192d-4af5-a273-955b1493d4b4/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 07 14:49:46.751494 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-d0c6d425-ef62-4724-b797-0d8d529b1bb9 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:46.752922 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-d0c6d425-ef62-4724-b797-0d8d529b1bb9 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e038fb54-192d-4af5-a273-955b1493d4b4] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:46.759418 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-d0c6d425-ef62-4724-b797-0d8d529b1bb9 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:46.759994 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-d0c6d425-ef62-4724-b797-0d8d529b1bb9 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:46.760755 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-d0c6d425-ef62-4724-b797-0d8d529b1bb9 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:46.761243 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-d0c6d425-ef62-4724-b797-0d8d529b1bb9 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:46.794056 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-d0c6d425-ef62-4724-b797-0d8d529b1bb9 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e038fb54-192d-4af5-a273-955b1493d4b4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049109 Jun 07 14:49:46.794605 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 509/1010] 10.222.0.85 () {58 vars in 1301 bytes} [Tue Jun 7 14:49:46 2022] GET /compute/v2.1/servers/e038fb54-192d-4af5-a273-955b1493d4b4/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 07 14:49:46.865508 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-02a414dc-c748-447a-ab1d-b9410493e9fe tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:46.866059 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-02a414dc-c748-447a-ab1d-b9410493e9fe tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e038fb54-192d-4af5-a273-955b1493d4b4] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:46.876126 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-02a414dc-c748-447a-ab1d-b9410493e9fe tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:46.876629 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-02a414dc-c748-447a-ab1d-b9410493e9fe tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:46.877426 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-02a414dc-c748-447a-ab1d-b9410493e9fe tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:46.877908 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-02a414dc-c748-447a-ab1d-b9410493e9fe tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:46.905308 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-02a414dc-c748-447a-ab1d-b9410493e9fe tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e038fb54-192d-4af5-a273-955b1493d4b4] Going to try to terminate instance {{(pid=118157) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 14:49:47.023043 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-a39002cf-bad0-4f8e-bf6e-7ce0b1b54e76 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:47.023662 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-a39002cf-bad0-4f8e-bf6e-7ce0b1b54e76 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: 89db7091-f026-4913-962e-ad45fd38b468] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:47.030594 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-a39002cf-bad0-4f8e-bf6e-7ce0b1b54e76 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:47.037067 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-a39002cf-bad0-4f8e-bf6e-7ce0b1b54e76 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:47.037067 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-a39002cf-bad0-4f8e-bf6e-7ce0b1b54e76 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:47.037067 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-a39002cf-bad0-4f8e-bf6e-7ce0b1b54e76 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:47.170950 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-a39002cf-bad0-4f8e-bf6e-7ce0b1b54e76 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:47.178993 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-a39002cf-bad0-4f8e-bf6e-7ce0b1b54e76 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:47.182774 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-a39002cf-bad0-4f8e-bf6e-7ce0b1b54e76 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:47.182774 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-a39002cf-bad0-4f8e-bf6e-7ce0b1b54e76 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468" status: 200 len: 1714 microversion: 2.20 time: 0.162657 Jun 07 14:49:47.183522 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 510/1011] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:49:47 2022] GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468 => generated 1714 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 14:49:47.277076 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-02a414dc-c748-447a-ab1d-b9410493e9fe tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "DELETE /compute/v2.1/servers/e038fb54-192d-4af5-a273-955b1493d4b4" status: 204 len: 0 microversion: 2.1 time: 0.415148 Jun 07 14:49:47.278343 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 502/1012] 10.222.0.85 () {58 vars in 1238 bytes} [Tue Jun 7 14:49:46 2022] DELETE /compute/v2.1/servers/e038fb54-192d-4af5-a273-955b1493d4b4 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 14:49:47.286743 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-466494fc-bb91-4eee-87f0-3d7bb4d98f4f tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:47.287357 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-466494fc-bb91-4eee-87f0-3d7bb4d98f4f tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e038fb54-192d-4af5-a273-955b1493d4b4] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:47.293405 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-466494fc-bb91-4eee-87f0-3d7bb4d98f4f tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:47.293867 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-466494fc-bb91-4eee-87f0-3d7bb4d98f4f tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:47.294633 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-466494fc-bb91-4eee-87f0-3d7bb4d98f4f tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:47.295075 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-466494fc-bb91-4eee-87f0-3d7bb4d98f4f tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:47.429376 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-466494fc-bb91-4eee-87f0-3d7bb4d98f4f tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb4b0cf5f8b4274b787f327793964f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ba26b86c7243dab8e6c6b84ed674e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:47.437590 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-466494fc-bb91-4eee-87f0-3d7bb4d98f4f tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e038fb54-192d-4af5-a273-955b1493d4b4" status: 200 len: 1675 microversion: 2.1 time: 0.154707 Jun 07 14:49:47.438152 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 511/1013] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:49:47 2022] GET /compute/v2.1/servers/e038fb54-192d-4af5-a273-955b1493d4b4 => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:49:47.503612 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-feb14dda-eda4-4b11-aab3-3843408db0df tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:47.504307 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-feb14dda-eda4-4b11-aab3-3843408db0df tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: 7bae9245-118c-4121-b43a-307dd6046a75] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:47.511232 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-feb14dda-eda4-4b11-aab3-3843408db0df tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:47.512484 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-feb14dda-eda4-4b11-aab3-3843408db0df tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:47.513725 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-feb14dda-eda4-4b11-aab3-3843408db0df tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:47.514382 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-feb14dda-eda4-4b11-aab3-3843408db0df tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:47.583058 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-feb14dda-eda4-4b11-aab3-3843408db0df tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15f5fa82414bdf8ca3f6723c0a8d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e877695d0f46339cb4b9b86aac3662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:47.596624 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-feb14dda-eda4-4b11-aab3-3843408db0df tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "GET /compute/v2.1/servers/7bae9245-118c-4121-b43a-307dd6046a75" status: 200 len: 1200 microversion: 2.1 time: 0.091244 Jun 07 14:49:47.596624 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 503/1014] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:49:47 2022] GET /compute/v2.1/servers/7bae9245-118c-4121-b43a-307dd6046a75 => generated 1200 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:49:48.097420 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-1bdcaf21-f4ef-45c7-b64c-5b27318db83e tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:48.098021 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-1bdcaf21-f4ef-45c7-b64c-5b27318db83e tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 46299ff5-499b-4ec8-b2d5-f876e3303a07] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:48.104387 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-1bdcaf21-f4ef-45c7-b64c-5b27318db83e tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:48.104856 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-1bdcaf21-f4ef-45c7-b64c-5b27318db83e tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:48.105614 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-1bdcaf21-f4ef-45c7-b64c-5b27318db83e tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:48.106047 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-1bdcaf21-f4ef-45c7-b64c-5b27318db83e tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:48.129330 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-1bdcaf21-f4ef-45c7-b64c-5b27318db83e tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/46299ff5-499b-4ec8-b2d5-f876e3303a07/ips" status: 200 len: 149 microversion: 2.1 time: 0.035760 Jun 07 14:49:48.129886 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 512/1015] 10.222.0.85 () {58 vars in 1247 bytes} [Tue Jun 7 14:49:48 2022] GET /compute/v2.1/servers/46299ff5-499b-4ec8-b2d5-f876e3303a07/ips => generated 149 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:49:48.457090 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-cd8670ef-17a4-40a0-913e-50d564e567eb tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:48.457090 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-cd8670ef-17a4-40a0-913e-50d564e567eb tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e038fb54-192d-4af5-a273-955b1493d4b4] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:48.462313 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-cd8670ef-17a4-40a0-913e-50d564e567eb tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:48.462776 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-cd8670ef-17a4-40a0-913e-50d564e567eb tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:48.463596 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-cd8670ef-17a4-40a0-913e-50d564e567eb tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:48.464036 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-cd8670ef-17a4-40a0-913e-50d564e567eb tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:48.613254 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-7a01a125-910c-4544-a456-cc9b62c3f274 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:48.613504 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-cd8670ef-17a4-40a0-913e-50d564e567eb tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb4b0cf5f8b4274b787f327793964f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ba26b86c7243dab8e6c6b84ed674e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:48.615015 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-7a01a125-910c-4544-a456-cc9b62c3f274 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: 7bae9245-118c-4121-b43a-307dd6046a75] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:48.622185 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-cd8670ef-17a4-40a0-913e-50d564e567eb tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e038fb54-192d-4af5-a273-955b1493d4b4" status: 200 len: 1675 microversion: 2.1 time: 0.170650 Jun 07 14:49:48.622746 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 504/1016] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:49:48 2022] GET /compute/v2.1/servers/e038fb54-192d-4af5-a273-955b1493d4b4 => generated 1675 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:49:48.626145 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-7a01a125-910c-4544-a456-cc9b62c3f274 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:48.626589 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-7a01a125-910c-4544-a456-cc9b62c3f274 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:48.627360 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-7a01a125-910c-4544-a456-cc9b62c3f274 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:48.627790 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-7a01a125-910c-4544-a456-cc9b62c3f274 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:48.632198 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG dbcounter [-] [118158] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=118158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:49:48.693277 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-7a01a125-910c-4544-a456-cc9b62c3f274 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15f5fa82414bdf8ca3f6723c0a8d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e877695d0f46339cb4b9b86aac3662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:48.701936 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-7a01a125-910c-4544-a456-cc9b62c3f274 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "GET /compute/v2.1/servers/7bae9245-118c-4121-b43a-307dd6046a75" status: 200 len: 1200 microversion: 2.1 time: 0.098384 Jun 07 14:49:48.702889 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 513/1017] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:49:48 2022] GET /compute/v2.1/servers/7bae9245-118c-4121-b43a-307dd6046a75 => generated 1200 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:49:49.640465 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-b07de62d-82ee-4c50-a753-9e0f63c14d57 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:49.641092 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-b07de62d-82ee-4c50-a753-9e0f63c14d57 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e038fb54-192d-4af5-a273-955b1493d4b4] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:49.648890 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-b07de62d-82ee-4c50-a753-9e0f63c14d57 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:49.649333 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-b07de62d-82ee-4c50-a753-9e0f63c14d57 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:49.650374 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-b07de62d-82ee-4c50-a753-9e0f63c14d57 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:49.650807 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-b07de62d-82ee-4c50-a753-9e0f63c14d57 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:49.724964 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-5a2aae25-dccb-43fa-ba26-8a68ac500be9 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:49.725596 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-5a2aae25-dccb-43fa-ba26-8a68ac500be9 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: 7bae9245-118c-4121-b43a-307dd6046a75] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:49.735750 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5a2aae25-dccb-43fa-ba26-8a68ac500be9 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:49.736212 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5a2aae25-dccb-43fa-ba26-8a68ac500be9 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:49.737095 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5a2aae25-dccb-43fa-ba26-8a68ac500be9 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:49.737537 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5a2aae25-dccb-43fa-ba26-8a68ac500be9 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:49.879027 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-b07de62d-82ee-4c50-a753-9e0f63c14d57 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb4b0cf5f8b4274b787f327793964f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ba26b86c7243dab8e6c6b84ed674e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:49.890343 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-b07de62d-82ee-4c50-a753-9e0f63c14d57 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e038fb54-192d-4af5-a273-955b1493d4b4" status: 200 len: 1675 microversion: 2.1 time: 0.254260 Jun 07 14:49:49.891614 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 505/1018] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:49:49 2022] GET /compute/v2.1/servers/e038fb54-192d-4af5-a273-955b1493d4b4 => generated 1675 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:49:50.020357 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-5a2aae25-dccb-43fa-ba26-8a68ac500be9 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15f5fa82414bdf8ca3f6723c0a8d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e877695d0f46339cb4b9b86aac3662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:50.033923 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-5a2aae25-dccb-43fa-ba26-8a68ac500be9 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "GET /compute/v2.1/servers/7bae9245-118c-4121-b43a-307dd6046a75" status: 200 len: 1278 microversion: 2.1 time: 0.312865 Jun 07 14:49:50.036749 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 514/1019] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:49:49 2022] GET /compute/v2.1/servers/7bae9245-118c-4121-b43a-307dd6046a75 => generated 1278 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:49:50.884118 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [req-77382f6e-c355-45ad-98dc-55aa5b543f94 req-39406d0c-613c-42ff-91cd-d7e42e826168 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e038fb54-192d-4af5-a273-955b1493d4b4", "name": "network-vif-deleted", "tag": "00a49620-6acb-4d1d-8c32-f724d94ef876"}]} {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:49:50.902103 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [req-77382f6e-c355-45ad-98dc-55aa5b543f94 req-39406d0c-613c-42ff-91cd-d7e42e826168 service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:50.903673 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [req-77382f6e-c355-45ad-98dc-55aa5b543f94 req-39406d0c-613c-42ff-91cd-d7e42e826168 service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:50.912601 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-2957dd2a-d22e-47cb-9644-1b92b8ad6a0c tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:50.914344 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-2957dd2a-d22e-47cb-9644-1b92b8ad6a0c tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e038fb54-192d-4af5-a273-955b1493d4b4] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:50.924802 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.compute.server_external_events [req-77382f6e-c355-45ad-98dc-55aa5b543f94 req-39406d0c-613c-42ff-91cd-d7e42e826168 service nova] Creating event network-vif-deleted:00a49620-6acb-4d1d-8c32-f724d94ef876 for instance e038fb54-192d-4af5-a273-955b1493d4b4 on hv-cinder-84497 Jun 07 14:49:50.925788 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-2957dd2a-d22e-47cb-9644-1b92b8ad6a0c tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:50.926428 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-2957dd2a-d22e-47cb-9644-1b92b8ad6a0c tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:50.927822 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-2957dd2a-d22e-47cb-9644-1b92b8ad6a0c tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:50.928588 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-2957dd2a-d22e-47cb-9644-1b92b8ad6a0c tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:50.936588 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [req-77382f6e-c355-45ad-98dc-55aa5b543f94 req-39406d0c-613c-42ff-91cd-d7e42e826168 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055925 Jun 07 14:49:50.939833 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 506/1020] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jun 7 14:49:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:49:50.961599 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-fcd9312d-c9af-4cbb-b593-717d13f4137f tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6fbe22e2-ecbf-4ffd-bab1-000b49a288ca"}} {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:49:50.963264 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-fcd9312d-c9af-4cbb-b593-717d13f4137f tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 46299ff5-499b-4ec8-b2d5-f876e3303a07] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:50.980147 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-fcd9312d-c9af-4cbb-b593-717d13f4137f tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:50.989094 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-fcd9312d-c9af-4cbb-b593-717d13f4137f tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:51.045917 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-fcd9312d-c9af-4cbb-b593-717d13f4137f tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:51.045917 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-fcd9312d-c9af-4cbb-b593-717d13f4137f tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:51.045917 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG dbcounter [-] [118157] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:49:51.047481 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-2957dd2a-d22e-47cb-9644-1b92b8ad6a0c tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb4b0cf5f8b4274b787f327793964f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ba26b86c7243dab8e6c6b84ed674e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:51.056693 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-2957dd2a-d22e-47cb-9644-1b92b8ad6a0c tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e038fb54-192d-4af5-a273-955b1493d4b4" status: 200 len: 1607 microversion: 2.1 time: 0.151742 Jun 07 14:49:51.057521 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 515/1021] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:49:50 2022] GET /compute/v2.1/servers/e038fb54-192d-4af5-a273-955b1493d4b4 => generated 1607 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:49:51.062544 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [req-296a583a-959a-470e-865a-2e1bd81f9fdd req-578f870d-2e08-40b3-8513-a7107fc5672e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bae9245-118c-4121-b43a-307dd6046a75", "tag": "d401233f-31c8-4f31-89d5-7671349fd7e0"}]} {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:49:51.071223 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [req-296a583a-959a-470e-865a-2e1bd81f9fdd req-578f870d-2e08-40b3-8513-a7107fc5672e service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:51.071943 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [req-296a583a-959a-470e-865a-2e1bd81f9fdd req-578f870d-2e08-40b3-8513-a7107fc5672e service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:51.095936 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.compute.server_external_events [req-296a583a-959a-470e-865a-2e1bd81f9fdd req-578f870d-2e08-40b3-8513-a7107fc5672e service nova] Creating event network-changed:d401233f-31c8-4f31-89d5-7671349fd7e0 for instance 7bae9245-118c-4121-b43a-307dd6046a75 on hv-cinder-84497 Jun 07 14:49:51.104811 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [req-296a583a-959a-470e-865a-2e1bd81f9fdd req-578f870d-2e08-40b3-8513-a7107fc5672e service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045108 Jun 07 14:49:51.106542 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 516/1022] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jun 7 14:49:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:49:51.114854 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-9ab6ff83-5c68-47fa-8927-70274a8a31af tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:51.115875 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-9ab6ff83-5c68-47fa-8927-70274a8a31af tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: 7bae9245-118c-4121-b43a-307dd6046a75] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:51.146810 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-9ab6ff83-5c68-47fa-8927-70274a8a31af tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:51.147264 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-9ab6ff83-5c68-47fa-8927-70274a8a31af tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:51.148278 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-9ab6ff83-5c68-47fa-8927-70274a8a31af tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:51.149591 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-9ab6ff83-5c68-47fa-8927-70274a8a31af tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:51.428678 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-9ab6ff83-5c68-47fa-8927-70274a8a31af tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15f5fa82414bdf8ca3f6723c0a8d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e877695d0f46339cb4b9b86aac3662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:51.438342 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-9ab6ff83-5c68-47fa-8927-70274a8a31af tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "GET /compute/v2.1/servers/7bae9245-118c-4121-b43a-307dd6046a75" status: 200 len: 1278 microversion: 2.1 time: 0.330394 Jun 07 14:49:51.439042 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 517/1023] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:49:51 2022] GET /compute/v2.1/servers/7bae9245-118c-4121-b43a-307dd6046a75 => generated 1278 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:49:51.755946 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-fcd9312d-c9af-4cbb-b593-717d13f4137f tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "POST /compute/v2.1/servers/46299ff5-499b-4ec8-b2d5-f876e3303a07/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.814252 Jun 07 14:49:51.756844 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 507/1024] 10.222.0.85 () {60 vars in 1322 bytes} [Tue Jun 7 14:49:50 2022] POST /compute/v2.1/servers/46299ff5-499b-4ec8-b2d5-f876e3303a07/os-volume_attachments => generated 194 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:49:52.085851 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-3166942b-64ae-4a24-a4a8-a119ae67a45b tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:52.087416 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-3166942b-64ae-4a24-a4a8-a119ae67a45b tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e038fb54-192d-4af5-a273-955b1493d4b4] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:52.095022 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-3166942b-64ae-4a24-a4a8-a119ae67a45b tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:52.095599 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-3166942b-64ae-4a24-a4a8-a119ae67a45b tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:52.098739 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-3166942b-64ae-4a24-a4a8-a119ae67a45b tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:52.098739 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-3166942b-64ae-4a24-a4a8-a119ae67a45b tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:52.112491 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.wsgi [None req-3166942b-64ae-4a24-a4a8-a119ae67a45b tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] HTTP exception thrown: Instance e038fb54-192d-4af5-a273-955b1493d4b4 could not be found. Jun 07 14:49:52.114266 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-3166942b-64ae-4a24-a4a8-a119ae67a45b tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Request method failure captured: Jun 07 14:49:52.114266 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: request: GET /compute/v2.1/servers/e038fb54-192d-4af5-a273-955b1493d4b4 HTTP/1.1 Jun 07 14:49:52.114266 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Accept: application/json Jun 07 14:49:52.114266 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Accept-Encoding: identity Jun 07 14:49:52.114266 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Connection: close Jun 07 14:49:52.114266 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Content-Length: 0 Jun 07 14:49:52.114266 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Content-Type: application/json Jun 07 14:49:52.114266 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Host: 10.222.0.85 Jun 07 14:49:52.114266 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Openstack-System-Scope: None Jun 07 14:49:52.114266 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: User-Agent: python-urllib3/1.26.9 Jun 07 14:49:52.114266 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Auth-Token: gAAAAABin2Mdptwt2bm6Ygpvo1z07HA83GDKDacru9YSte997O9m3xiuuMufkDvVtfUolJbez-VskeP9fwc6GcGNbcXcUKLOn7jWNFG1YRk8n4-RNwJRsnaMq3LqApUiRgJ59ZeFndh0vNb-0kuvJIBCImSgZYyoqwtghJVYN2X11w1VavHgQyM Jun 07 14:49:52.114266 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Domain-Id: None Jun 07 14:49:52.114266 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Domain-Name: None Jun 07 14:49:52.114266 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Identity-Status: Confirmed Jun 07 14:49:52.114266 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Is-Admin-Project: True Jun 07 14:49:52.114266 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Domain-Id: default Jun 07 14:49:52.114266 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Domain-Name: Default Jun 07 14:49:52.114266 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Id: 97ba26b86c7243dab8e6c6b84ed674e8 Jun 07 14:49:52.114266 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Name: tempest-AttachVolumeTestJSON-126212865 Jun 07 14:49:52.114266 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Role: member,reader Jun 07 14:49:52.114266 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Roles: member,reader Jun 07 14:49:52.122239 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/97ba26b86c7243dab8e6c6b84ed674e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_97ba26b86c7243dab8e6c6b84ed674e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/97ba26b86c7243dab8e6c6b84ed674e8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/97ba26b86c7243dab8e6c6b84ed674e8"}]}] Jun 07 14:49:52.122239 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Tenant: tempest-AttachVolumeTestJSON-126212865 Jun 07 14:49:52.122239 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Tenant-Id: 97ba26b86c7243dab8e6c6b84ed674e8 Jun 07 14:49:52.122239 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Tenant-Name: tempest-AttachVolumeTestJSON-126212865 Jun 07 14:49:52.122239 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User: tempest-AttachVolumeTestJSON-126212865-project Jun 07 14:49:52.122239 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Domain-Id: default Jun 07 14:49:52.122239 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Domain-Name: Default Jun 07 14:49:52.122239 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Id: 4fb4b0cf5f8b4274b787f327793964f3 Jun 07 14:49:52.122239 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Name: tempest-AttachVolumeTestJSON-126212865-project Jun 07 14:49:52.122239 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: method: > Jun 07 14:49:52.122239 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: exception: Instance e038fb54-192d-4af5-a273-955b1493d4b4 could not be found. Jun 07 14:49:52.122239 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: action_args: {'id': 'e038fb54-192d-4af5-a273-955b1493d4b4'} Jun 07 14:49:52.123015 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:49:52.123015 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:49:52.123015 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 14:49:52.123015 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 14:49:52.123015 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 14:49:52.123015 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 14:49:52.123015 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 14:49:52.123015 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 14:49:52.123015 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 14:49:52.123015 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 14:49:52.123015 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e038fb54-192d-4af5-a273-955b1493d4b4 could not be found. Jun 07 14:49:52.123015 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:49:52.123015 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:49:52.123015 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:49:52.123015 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:49:52.123015 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:49:52.123015 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:49:52.123015 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:49:52.123015 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:49:52.123015 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:49:52.124436 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:49:52.124436 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 14:49:52.124436 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 14:49:52.124436 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 14:49:52.124436 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 14:49:52.124436 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 14:49:52.124436 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:49:52.124436 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e038fb54-192d-4af5-a273-955b1493d4b4 could not be found. Jun 07 14:49:52.124436 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:49:52.124436 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:49:52.124436 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:49:52.124436 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:49:52.124436 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:49:52.124436 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:49:52.124436 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:49:52.124436 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:49:52.124436 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e038fb54-192d-4af5-a273-955b1493d4b4 could not be found. Jun 07 14:49:52.124436 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:49:52.125667 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-3166942b-64ae-4a24-a4a8-a119ae67a45b tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Returning 404 to user: Instance e038fb54-192d-4af5-a273-955b1493d4b4 could not be found. {{(pid=118158) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:49:52.125667 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-3166942b-64ae-4a24-a4a8-a119ae67a45b tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e038fb54-192d-4af5-a273-955b1493d4b4" status: 404 len: 111 microversion: 2.1 time: 0.033936 Jun 07 14:49:52.125667 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 518/1025] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:49:52 2022] GET /compute/v2.1/servers/e038fb54-192d-4af5-a273-955b1493d4b4 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 14:49:52.132236 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-bd8e005e-6e61-45b1-b42b-7f79f51524a2 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '.version_select at 0x7f5f88111430>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:52.198636 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-bd8e005e-6e61-45b1-b42b-7f79f51524a2 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1383653833" status: 202 len: 0 microversion: 2.1 time: 0.071308 Jun 07 14:49:52.199606 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 508/1026] 10.222.0.85 () {58 vars in 1220 bytes} [Tue Jun 7 14:49:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1383653833 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 07 14:49:52.455659 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-c2f546e5-84aa-4a00-afd3-dce50b0bceb6 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:52.456480 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-c2f546e5-84aa-4a00-afd3-dce50b0bceb6 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: 7bae9245-118c-4121-b43a-307dd6046a75] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:52.462654 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-c2f546e5-84aa-4a00-afd3-dce50b0bceb6 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:52.463397 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-c2f546e5-84aa-4a00-afd3-dce50b0bceb6 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:52.464250 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-c2f546e5-84aa-4a00-afd3-dce50b0bceb6 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:52.465379 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-c2f546e5-84aa-4a00-afd3-dce50b0bceb6 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:52.708928 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-c2f546e5-84aa-4a00-afd3-dce50b0bceb6 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15f5fa82414bdf8ca3f6723c0a8d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e877695d0f46339cb4b9b86aac3662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:52.716555 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-c2f546e5-84aa-4a00-afd3-dce50b0bceb6 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "GET /compute/v2.1/servers/7bae9245-118c-4121-b43a-307dd6046a75" status: 200 len: 1278 microversion: 2.1 time: 0.264815 Jun 07 14:49:52.717182 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 519/1027] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:49:52 2022] GET /compute/v2.1/servers/7bae9245-118c-4121-b43a-307dd6046a75 => generated 1278 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:49:53.735207 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-067a81c6-15ec-4389-a30c-86a426f6628e tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:53.735933 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-067a81c6-15ec-4389-a30c-86a426f6628e tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: 7bae9245-118c-4121-b43a-307dd6046a75] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:53.737870 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG dbcounter [-] [118157] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:49:53.743743 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-067a81c6-15ec-4389-a30c-86a426f6628e tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:53.744199 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-067a81c6-15ec-4389-a30c-86a426f6628e tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:53.745012 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-067a81c6-15ec-4389-a30c-86a426f6628e tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:53.745455 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-067a81c6-15ec-4389-a30c-86a426f6628e tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:53.877916 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-067a81c6-15ec-4389-a30c-86a426f6628e tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15f5fa82414bdf8ca3f6723c0a8d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e877695d0f46339cb4b9b86aac3662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:53.885451 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-067a81c6-15ec-4389-a30c-86a426f6628e tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "GET /compute/v2.1/servers/7bae9245-118c-4121-b43a-307dd6046a75" status: 200 len: 1278 microversion: 2.1 time: 0.155589 Jun 07 14:49:53.890090 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 509/1028] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:49:53 2022] GET /compute/v2.1/servers/7bae9245-118c-4121-b43a-307dd6046a75 => generated 1278 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:49:54.902877 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-51229adc-2a2d-433d-a148-20ccdfb22ff9 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:54.903399 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-51229adc-2a2d-433d-a148-20ccdfb22ff9 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: 7bae9245-118c-4121-b43a-307dd6046a75] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:54.905344 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG dbcounter [-] [118158] Writing DB stats nova_cell0:SELECT=2 {{(pid=118158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:49:54.910863 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-51229adc-2a2d-433d-a148-20ccdfb22ff9 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:54.911312 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-51229adc-2a2d-433d-a148-20ccdfb22ff9 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:54.912076 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-51229adc-2a2d-433d-a148-20ccdfb22ff9 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:54.912544 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-51229adc-2a2d-433d-a148-20ccdfb22ff9 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:55.050820 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-51229adc-2a2d-433d-a148-20ccdfb22ff9 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15f5fa82414bdf8ca3f6723c0a8d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e877695d0f46339cb4b9b86aac3662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:55.062782 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-51229adc-2a2d-433d-a148-20ccdfb22ff9 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "GET /compute/v2.1/servers/7bae9245-118c-4121-b43a-307dd6046a75" status: 200 len: 1278 microversion: 2.1 time: 0.164542 Jun 07 14:49:55.063347 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 520/1029] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:49:54 2022] GET /compute/v2.1/servers/7bae9245-118c-4121-b43a-307dd6046a75 => generated 1278 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:49:55.635519 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-ac959dde-c7c9-4a4e-8819-1699c0c47a25 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:55.636024 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-ac959dde-c7c9-4a4e-8819-1699c0c47a25 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e038fb54-192d-4af5-a273-955b1493d4b4] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:55.638479 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG dbcounter [-] [118157] Writing DB stats nova_cell0:SELECT=2 {{(pid=118157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:49:55.639227 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG dbcounter [-] [118157] Writing DB stats nova_cell0:SELECT=8 {{(pid=118157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:49:55.644436 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-ac959dde-c7c9-4a4e-8819-1699c0c47a25 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:55.644892 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-ac959dde-c7c9-4a4e-8819-1699c0c47a25 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:55.645679 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-ac959dde-c7c9-4a4e-8819-1699c0c47a25 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:55.646123 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-ac959dde-c7c9-4a4e-8819-1699c0c47a25 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:55.660509 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.wsgi [None req-ac959dde-c7c9-4a4e-8819-1699c0c47a25 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] HTTP exception thrown: Instance e038fb54-192d-4af5-a273-955b1493d4b4 could not be found. Jun 07 14:49:55.662177 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-ac959dde-c7c9-4a4e-8819-1699c0c47a25 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Request method failure captured: Jun 07 14:49:55.662177 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: request: DELETE /compute/v2.1/servers/e038fb54-192d-4af5-a273-955b1493d4b4 HTTP/1.1 Jun 07 14:49:55.662177 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Accept: application/json Jun 07 14:49:55.662177 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Accept-Encoding: identity Jun 07 14:49:55.662177 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Connection: close Jun 07 14:49:55.662177 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Content-Length: 0 Jun 07 14:49:55.662177 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Content-Type: application/json Jun 07 14:49:55.662177 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Host: 10.222.0.85 Jun 07 14:49:55.662177 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Openstack-System-Scope: None Jun 07 14:49:55.662177 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: User-Agent: python-urllib3/1.26.9 Jun 07 14:49:55.662177 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Auth-Token: gAAAAABin2Mdptwt2bm6Ygpvo1z07HA83GDKDacru9YSte997O9m3xiuuMufkDvVtfUolJbez-VskeP9fwc6GcGNbcXcUKLOn7jWNFG1YRk8n4-RNwJRsnaMq3LqApUiRgJ59ZeFndh0vNb-0kuvJIBCImSgZYyoqwtghJVYN2X11w1VavHgQyM Jun 07 14:49:55.662177 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Domain-Id: None Jun 07 14:49:55.662177 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Domain-Name: None Jun 07 14:49:55.662177 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Identity-Status: Confirmed Jun 07 14:49:55.662177 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Is-Admin-Project: True Jun 07 14:49:55.662177 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Project-Domain-Id: default Jun 07 14:49:55.662177 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Project-Domain-Name: Default Jun 07 14:49:55.662177 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Project-Id: 97ba26b86c7243dab8e6c6b84ed674e8 Jun 07 14:49:55.662177 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Project-Name: tempest-AttachVolumeTestJSON-126212865 Jun 07 14:49:55.662177 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Role: member,reader Jun 07 14:49:55.662177 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Roles: member,reader Jun 07 14:49:55.663756 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/97ba26b86c7243dab8e6c6b84ed674e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_97ba26b86c7243dab8e6c6b84ed674e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/97ba26b86c7243dab8e6c6b84ed674e8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/97ba26b86c7243dab8e6c6b84ed674e8"}]}] Jun 07 14:49:55.663756 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Tenant: tempest-AttachVolumeTestJSON-126212865 Jun 07 14:49:55.663756 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Tenant-Id: 97ba26b86c7243dab8e6c6b84ed674e8 Jun 07 14:49:55.663756 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Tenant-Name: tempest-AttachVolumeTestJSON-126212865 Jun 07 14:49:55.663756 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User: tempest-AttachVolumeTestJSON-126212865-project Jun 07 14:49:55.663756 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User-Domain-Id: default Jun 07 14:49:55.663756 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User-Domain-Name: Default Jun 07 14:49:55.663756 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User-Id: 4fb4b0cf5f8b4274b787f327793964f3 Jun 07 14:49:55.663756 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User-Name: tempest-AttachVolumeTestJSON-126212865-project Jun 07 14:49:55.663756 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: method: > Jun 07 14:49:55.663756 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: exception: Instance e038fb54-192d-4af5-a273-955b1493d4b4 could not be found. Jun 07 14:49:55.663756 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: action_args: {'id': 'e038fb54-192d-4af5-a273-955b1493d4b4'} Jun 07 14:49:55.664651 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:49:55.664651 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:49:55.664651 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 14:49:55.664651 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 14:49:55.664651 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 14:49:55.664651 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 14:49:55.664651 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 14:49:55.664651 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 14:49:55.664651 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 14:49:55.664651 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 14:49:55.664651 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e038fb54-192d-4af5-a273-955b1493d4b4 could not be found. Jun 07 14:49:55.664651 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:49:55.664651 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:49:55.664651 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:49:55.664651 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:49:55.664651 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:49:55.664651 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:49:55.664651 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:49:55.664651 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:49:55.664651 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:49:55.666104 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:49:55.666104 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 07 14:49:55.666104 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 07 14:49:55.666104 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 07 14:49:55.666104 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 07 14:49:55.666104 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 14:49:55.666104 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 14:49:55.666104 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 14:49:55.666104 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:49:55.666104 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e038fb54-192d-4af5-a273-955b1493d4b4 could not be found. Jun 07 14:49:55.666104 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:49:55.666104 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:49:55.666104 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:49:55.666104 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:49:55.666104 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:49:55.666104 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:49:55.666104 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:49:55.666104 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:49:55.666104 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e038fb54-192d-4af5-a273-955b1493d4b4 could not be found. Jun 07 14:49:55.666104 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:49:55.667664 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-ac959dde-c7c9-4a4e-8819-1699c0c47a25 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Returning 404 to user: Instance e038fb54-192d-4af5-a273-955b1493d4b4 could not be found. {{(pid=118157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:49:55.667664 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-ac959dde-c7c9-4a4e-8819-1699c0c47a25 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "DELETE /compute/v2.1/servers/e038fb54-192d-4af5-a273-955b1493d4b4" status: 404 len: 111 microversion: 2.1 time: 0.032332 Jun 07 14:49:55.667664 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 510/1030] 10.222.0.85 () {58 vars in 1238 bytes} [Tue Jun 7 14:49:55 2022] DELETE /compute/v2.1/servers/e038fb54-192d-4af5-a273-955b1493d4b4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 14:49:55.672778 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-e6be75b7-5286-4b99-8a09-7cba6287a918 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:55.673422 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-e6be75b7-5286-4b99-8a09-7cba6287a918 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e038fb54-192d-4af5-a273-955b1493d4b4] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:55.679505 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-e6be75b7-5286-4b99-8a09-7cba6287a918 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:55.679887 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-e6be75b7-5286-4b99-8a09-7cba6287a918 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:55.680669 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-e6be75b7-5286-4b99-8a09-7cba6287a918 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:55.681107 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-e6be75b7-5286-4b99-8a09-7cba6287a918 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:55.694343 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.wsgi [None req-e6be75b7-5286-4b99-8a09-7cba6287a918 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] HTTP exception thrown: Instance e038fb54-192d-4af5-a273-955b1493d4b4 could not be found. Jun 07 14:49:55.695848 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-e6be75b7-5286-4b99-8a09-7cba6287a918 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Request method failure captured: Jun 07 14:49:55.695848 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: request: GET /compute/v2.1/servers/e038fb54-192d-4af5-a273-955b1493d4b4 HTTP/1.1 Jun 07 14:49:55.695848 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Accept: application/json Jun 07 14:49:55.695848 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Accept-Encoding: identity Jun 07 14:49:55.695848 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Connection: close Jun 07 14:49:55.695848 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Content-Length: 0 Jun 07 14:49:55.695848 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Content-Type: application/json Jun 07 14:49:55.695848 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Host: 10.222.0.85 Jun 07 14:49:55.695848 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Openstack-System-Scope: None Jun 07 14:49:55.695848 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: User-Agent: python-urllib3/1.26.9 Jun 07 14:49:55.695848 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Auth-Token: gAAAAABin2Mdptwt2bm6Ygpvo1z07HA83GDKDacru9YSte997O9m3xiuuMufkDvVtfUolJbez-VskeP9fwc6GcGNbcXcUKLOn7jWNFG1YRk8n4-RNwJRsnaMq3LqApUiRgJ59ZeFndh0vNb-0kuvJIBCImSgZYyoqwtghJVYN2X11w1VavHgQyM Jun 07 14:49:55.695848 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Domain-Id: None Jun 07 14:49:55.695848 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Domain-Name: None Jun 07 14:49:55.695848 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Identity-Status: Confirmed Jun 07 14:49:55.695848 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Is-Admin-Project: True Jun 07 14:49:55.695848 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Domain-Id: default Jun 07 14:49:55.695848 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Domain-Name: Default Jun 07 14:49:55.695848 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Id: 97ba26b86c7243dab8e6c6b84ed674e8 Jun 07 14:49:55.695848 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Name: tempest-AttachVolumeTestJSON-126212865 Jun 07 14:49:55.695848 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Role: member,reader Jun 07 14:49:55.695848 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Roles: member,reader Jun 07 14:49:55.697333 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/97ba26b86c7243dab8e6c6b84ed674e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_97ba26b86c7243dab8e6c6b84ed674e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/97ba26b86c7243dab8e6c6b84ed674e8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/97ba26b86c7243dab8e6c6b84ed674e8"}]}] Jun 07 14:49:55.697333 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Tenant: tempest-AttachVolumeTestJSON-126212865 Jun 07 14:49:55.697333 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Tenant-Id: 97ba26b86c7243dab8e6c6b84ed674e8 Jun 07 14:49:55.697333 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Tenant-Name: tempest-AttachVolumeTestJSON-126212865 Jun 07 14:49:55.697333 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User: tempest-AttachVolumeTestJSON-126212865-project Jun 07 14:49:55.697333 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Domain-Id: default Jun 07 14:49:55.697333 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Domain-Name: Default Jun 07 14:49:55.697333 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Id: 4fb4b0cf5f8b4274b787f327793964f3 Jun 07 14:49:55.697333 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Name: tempest-AttachVolumeTestJSON-126212865-project Jun 07 14:49:55.697333 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: method: > Jun 07 14:49:55.697333 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: exception: Instance e038fb54-192d-4af5-a273-955b1493d4b4 could not be found. Jun 07 14:49:55.697333 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: action_args: {'id': 'e038fb54-192d-4af5-a273-955b1493d4b4'} Jun 07 14:49:55.698242 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:49:55.698242 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:49:55.698242 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 14:49:55.698242 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 14:49:55.698242 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 14:49:55.698242 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 14:49:55.698242 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 14:49:55.698242 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 14:49:55.698242 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 14:49:55.698242 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 14:49:55.698242 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e038fb54-192d-4af5-a273-955b1493d4b4 could not be found. Jun 07 14:49:55.698242 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:49:55.698242 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:49:55.698242 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:49:55.698242 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:49:55.698242 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:49:55.698242 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:49:55.698242 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:49:55.698242 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:49:55.698242 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:49:55.699605 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:49:55.699605 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 14:49:55.699605 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 14:49:55.699605 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 14:49:55.699605 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 14:49:55.699605 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 14:49:55.699605 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:49:55.699605 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e038fb54-192d-4af5-a273-955b1493d4b4 could not be found. Jun 07 14:49:55.699605 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:49:55.699605 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:49:55.699605 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:49:55.699605 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:49:55.699605 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:49:55.699605 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:49:55.699605 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:49:55.699605 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:49:55.699605 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e038fb54-192d-4af5-a273-955b1493d4b4 could not be found. Jun 07 14:49:55.699605 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:49:55.701064 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-e6be75b7-5286-4b99-8a09-7cba6287a918 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Returning 404 to user: Instance e038fb54-192d-4af5-a273-955b1493d4b4 could not be found. {{(pid=118158) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:49:55.701064 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-e6be75b7-5286-4b99-8a09-7cba6287a918 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e038fb54-192d-4af5-a273-955b1493d4b4" status: 404 len: 111 microversion: 2.1 time: 0.028919 Jun 07 14:49:55.701064 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 521/1031] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:49:55 2022] GET /compute/v2.1/servers/e038fb54-192d-4af5-a273-955b1493d4b4 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 14:49:56.079529 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-28f3554c-b077-40f0-b493-b7cc75aa2031 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:56.080149 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-28f3554c-b077-40f0-b493-b7cc75aa2031 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: 7bae9245-118c-4121-b43a-307dd6046a75] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:56.088363 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-28f3554c-b077-40f0-b493-b7cc75aa2031 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:56.088843 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-28f3554c-b077-40f0-b493-b7cc75aa2031 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:56.090221 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-28f3554c-b077-40f0-b493-b7cc75aa2031 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:56.090694 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-28f3554c-b077-40f0-b493-b7cc75aa2031 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:56.233571 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-28f3554c-b077-40f0-b493-b7cc75aa2031 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15f5fa82414bdf8ca3f6723c0a8d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e877695d0f46339cb4b9b86aac3662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:56.240999 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-28f3554c-b077-40f0-b493-b7cc75aa2031 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "GET /compute/v2.1/servers/7bae9245-118c-4121-b43a-307dd6046a75" status: 200 len: 1278 microversion: 2.1 time: 0.165393 Jun 07 14:49:56.241553 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 511/1032] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:49:56 2022] GET /compute/v2.1/servers/7bae9245-118c-4121-b43a-307dd6046a75 => generated 1278 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:49:56.278703 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-3a228028-6040-43ed-a77a-458900ea0f8d tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:56.279329 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-3a228028-6040-43ed-a77a-458900ea0f8d tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] [instance: 75e38ceb-ae6e-456f-968b-90e5f4f39d37] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:56.285936 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-3a228028-6040-43ed-a77a-458900ea0f8d tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:56.286390 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-3a228028-6040-43ed-a77a-458900ea0f8d tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:56.287162 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-3a228028-6040-43ed-a77a-458900ea0f8d tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:56.287602 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-3a228028-6040-43ed-a77a-458900ea0f8d tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:56.428308 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-3a228028-6040-43ed-a77a-458900ea0f8d tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b3f5c080034b658cbfb311c0c77b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b63567b3e54cf1a4348fb65b65a040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:56.436866 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-3a228028-6040-43ed-a77a-458900ea0f8d tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] 10.222.0.85 "GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37" status: 200 len: 1596 microversion: 2.1 time: 0.162922 Jun 07 14:49:56.437427 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 522/1033] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:49:56 2022] GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37 => generated 1596 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:49:56.981637 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-106cd809-f8b4-47d1-ab85-9f05028dcff2 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:56.982140 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-106cd809-f8b4-47d1-ab85-9f05028dcff2 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:56.988801 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-106cd809-f8b4-47d1-ab85-9f05028dcff2 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:56.989249 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-106cd809-f8b4-47d1-ab85-9f05028dcff2 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:56.990010 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-106cd809-f8b4-47d1-ab85-9f05028dcff2 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:56.990443 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-106cd809-f8b4-47d1-ab85-9f05028dcff2 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:57.006048 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.wsgi [None req-106cd809-f8b4-47d1-ab85-9f05028dcff2 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] HTTP exception thrown: Instance e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 could not be found. Jun 07 14:49:57.007607 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-106cd809-f8b4-47d1-ab85-9f05028dcff2 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Request method failure captured: Jun 07 14:49:57.007607 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: request: DELETE /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 HTTP/1.1 Jun 07 14:49:57.007607 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Accept: application/json Jun 07 14:49:57.007607 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Accept-Encoding: identity Jun 07 14:49:57.007607 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Connection: close Jun 07 14:49:57.007607 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Content-Length: 0 Jun 07 14:49:57.007607 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Content-Type: application/json Jun 07 14:49:57.007607 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Host: 10.222.0.85 Jun 07 14:49:57.007607 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Openstack-System-Scope: None Jun 07 14:49:57.007607 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: User-Agent: python-urllib3/1.26.9 Jun 07 14:49:57.007607 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Auth-Token: gAAAAABin2Mdptwt2bm6Ygpvo1z07HA83GDKDacru9YSte997O9m3xiuuMufkDvVtfUolJbez-VskeP9fwc6GcGNbcXcUKLOn7jWNFG1YRk8n4-RNwJRsnaMq3LqApUiRgJ59ZeFndh0vNb-0kuvJIBCImSgZYyoqwtghJVYN2X11w1VavHgQyM Jun 07 14:49:57.007607 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Domain-Id: None Jun 07 14:49:57.007607 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Domain-Name: None Jun 07 14:49:57.007607 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Identity-Status: Confirmed Jun 07 14:49:57.007607 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Is-Admin-Project: True Jun 07 14:49:57.007607 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Project-Domain-Id: default Jun 07 14:49:57.007607 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Project-Domain-Name: Default Jun 07 14:49:57.007607 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Project-Id: 97ba26b86c7243dab8e6c6b84ed674e8 Jun 07 14:49:57.007607 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Project-Name: tempest-AttachVolumeTestJSON-126212865 Jun 07 14:49:57.007607 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Role: member,reader Jun 07 14:49:57.007607 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Roles: member,reader Jun 07 14:49:57.009226 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/97ba26b86c7243dab8e6c6b84ed674e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_97ba26b86c7243dab8e6c6b84ed674e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/97ba26b86c7243dab8e6c6b84ed674e8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/97ba26b86c7243dab8e6c6b84ed674e8"}]}] Jun 07 14:49:57.009226 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Tenant: tempest-AttachVolumeTestJSON-126212865 Jun 07 14:49:57.009226 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Tenant-Id: 97ba26b86c7243dab8e6c6b84ed674e8 Jun 07 14:49:57.009226 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Tenant-Name: tempest-AttachVolumeTestJSON-126212865 Jun 07 14:49:57.009226 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User: tempest-AttachVolumeTestJSON-126212865-project Jun 07 14:49:57.009226 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User-Domain-Id: default Jun 07 14:49:57.009226 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User-Domain-Name: Default Jun 07 14:49:57.009226 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User-Id: 4fb4b0cf5f8b4274b787f327793964f3 Jun 07 14:49:57.009226 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User-Name: tempest-AttachVolumeTestJSON-126212865-project Jun 07 14:49:57.009226 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: method: > Jun 07 14:49:57.009226 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: exception: Instance e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 could not be found. Jun 07 14:49:57.009226 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: action_args: {'id': 'e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6'} Jun 07 14:49:57.010065 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:49:57.010065 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:49:57.010065 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 14:49:57.010065 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 14:49:57.010065 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 14:49:57.010065 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 14:49:57.010065 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 14:49:57.010065 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 14:49:57.010065 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 14:49:57.010065 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 14:49:57.010065 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 could not be found. Jun 07 14:49:57.010065 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:49:57.010065 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:49:57.010065 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:49:57.010065 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:49:57.010065 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:49:57.010065 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:49:57.010065 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:49:57.010065 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:49:57.010065 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:49:57.012020 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:49:57.012020 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 07 14:49:57.012020 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 07 14:49:57.012020 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 07 14:49:57.012020 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 07 14:49:57.012020 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 14:49:57.012020 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 14:49:57.012020 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 14:49:57.012020 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:49:57.012020 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 could not be found. Jun 07 14:49:57.012020 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:49:57.012020 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:49:57.012020 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:49:57.012020 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:49:57.012020 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:49:57.012020 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:49:57.012020 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:49:57.012020 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:49:57.012020 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 could not be found. Jun 07 14:49:57.012020 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:49:57.013938 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-106cd809-f8b4-47d1-ab85-9f05028dcff2 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Returning 404 to user: Instance e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 could not be found. {{(pid=118157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:49:57.013938 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-106cd809-f8b4-47d1-ab85-9f05028dcff2 tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "DELETE /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6" status: 404 len: 111 microversion: 2.1 time: 0.031200 Jun 07 14:49:57.013938 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 512/1034] 10.222.0.85 () {58 vars in 1238 bytes} [Tue Jun 7 14:49:56 2022] DELETE /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 14:49:57.018178 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-33be2f02-8f42-4c45-a67a-e50049fda8bd tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:57.018811 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-33be2f02-8f42-4c45-a67a-e50049fda8bd tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] [instance: e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:57.025192 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-33be2f02-8f42-4c45-a67a-e50049fda8bd tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:57.025639 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-33be2f02-8f42-4c45-a67a-e50049fda8bd tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:57.026405 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-33be2f02-8f42-4c45-a67a-e50049fda8bd tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:57.026837 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-33be2f02-8f42-4c45-a67a-e50049fda8bd tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:57.047626 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.wsgi [None req-33be2f02-8f42-4c45-a67a-e50049fda8bd tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] HTTP exception thrown: Instance e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 could not be found. Jun 07 14:49:57.049210 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-33be2f02-8f42-4c45-a67a-e50049fda8bd tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Request method failure captured: Jun 07 14:49:57.049210 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: request: GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 HTTP/1.1 Jun 07 14:49:57.049210 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Accept: application/json Jun 07 14:49:57.049210 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Accept-Encoding: identity Jun 07 14:49:57.049210 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Connection: close Jun 07 14:49:57.049210 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Content-Length: 0 Jun 07 14:49:57.049210 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Content-Type: application/json Jun 07 14:49:57.049210 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Host: 10.222.0.85 Jun 07 14:49:57.049210 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Openstack-System-Scope: None Jun 07 14:49:57.049210 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: User-Agent: python-urllib3/1.26.9 Jun 07 14:49:57.049210 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Auth-Token: gAAAAABin2Mdptwt2bm6Ygpvo1z07HA83GDKDacru9YSte997O9m3xiuuMufkDvVtfUolJbez-VskeP9fwc6GcGNbcXcUKLOn7jWNFG1YRk8n4-RNwJRsnaMq3LqApUiRgJ59ZeFndh0vNb-0kuvJIBCImSgZYyoqwtghJVYN2X11w1VavHgQyM Jun 07 14:49:57.049210 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Domain-Id: None Jun 07 14:49:57.049210 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Domain-Name: None Jun 07 14:49:57.049210 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Identity-Status: Confirmed Jun 07 14:49:57.049210 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Is-Admin-Project: True Jun 07 14:49:57.049210 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Domain-Id: default Jun 07 14:49:57.049210 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Domain-Name: Default Jun 07 14:49:57.049210 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Id: 97ba26b86c7243dab8e6c6b84ed674e8 Jun 07 14:49:57.049210 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Name: tempest-AttachVolumeTestJSON-126212865 Jun 07 14:49:57.049210 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Role: member,reader Jun 07 14:49:57.049210 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Roles: member,reader Jun 07 14:49:57.052725 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/97ba26b86c7243dab8e6c6b84ed674e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_97ba26b86c7243dab8e6c6b84ed674e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/97ba26b86c7243dab8e6c6b84ed674e8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/97ba26b86c7243dab8e6c6b84ed674e8"}]}] Jun 07 14:49:57.052725 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Tenant: tempest-AttachVolumeTestJSON-126212865 Jun 07 14:49:57.052725 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Tenant-Id: 97ba26b86c7243dab8e6c6b84ed674e8 Jun 07 14:49:57.052725 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Tenant-Name: tempest-AttachVolumeTestJSON-126212865 Jun 07 14:49:57.052725 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User: tempest-AttachVolumeTestJSON-126212865-project Jun 07 14:49:57.052725 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Domain-Id: default Jun 07 14:49:57.052725 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Domain-Name: Default Jun 07 14:49:57.052725 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Id: 4fb4b0cf5f8b4274b787f327793964f3 Jun 07 14:49:57.052725 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Name: tempest-AttachVolumeTestJSON-126212865-project Jun 07 14:49:57.052725 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: method: > Jun 07 14:49:57.052725 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: exception: Instance e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 could not be found. Jun 07 14:49:57.052725 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: action_args: {'id': 'e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6'} Jun 07 14:49:57.053637 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:49:57.053637 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:49:57.053637 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 14:49:57.053637 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 14:49:57.053637 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 14:49:57.053637 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 14:49:57.053637 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 14:49:57.053637 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 14:49:57.053637 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 14:49:57.053637 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 14:49:57.053637 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 could not be found. Jun 07 14:49:57.053637 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:49:57.053637 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:49:57.053637 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:49:57.053637 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:49:57.053637 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:49:57.053637 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:49:57.053637 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:49:57.053637 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:49:57.053637 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:49:57.055074 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:49:57.055074 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 14:49:57.055074 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 14:49:57.055074 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 14:49:57.055074 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 14:49:57.055074 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 14:49:57.055074 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:49:57.055074 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 could not be found. Jun 07 14:49:57.055074 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:49:57.055074 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:49:57.055074 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:49:57.055074 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:49:57.055074 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:49:57.055074 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:49:57.055074 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:49:57.055074 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:49:57.055074 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 could not be found. Jun 07 14:49:57.055074 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:49:57.056399 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-33be2f02-8f42-4c45-a67a-e50049fda8bd tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] Returning 404 to user: Instance e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 could not be found. {{(pid=118158) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:49:57.056399 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-33be2f02-8f42-4c45-a67a-e50049fda8bd tempest-AttachVolumeTestJSON-126212865 tempest-AttachVolumeTestJSON-126212865-project] 10.222.0.85 "GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6" status: 404 len: 111 microversion: 2.1 time: 0.036528 Jun 07 14:49:57.056721 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 523/1035] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:49:57 2022] GET /compute/v2.1/servers/e8dbb763-2ce4-49ac-b76d-02e55fc5f5a6 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 14:49:57.258326 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-46ea963a-97ef-4d70-8a6d-06748bdb4ee4 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:57.258952 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-46ea963a-97ef-4d70-8a6d-06748bdb4ee4 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: 7bae9245-118c-4121-b43a-307dd6046a75] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:57.265826 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-46ea963a-97ef-4d70-8a6d-06748bdb4ee4 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:57.266307 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-46ea963a-97ef-4d70-8a6d-06748bdb4ee4 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:57.267294 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-46ea963a-97ef-4d70-8a6d-06748bdb4ee4 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:57.268046 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-46ea963a-97ef-4d70-8a6d-06748bdb4ee4 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:57.503819 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-46ea963a-97ef-4d70-8a6d-06748bdb4ee4 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15f5fa82414bdf8ca3f6723c0a8d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e877695d0f46339cb4b9b86aac3662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:57.511314 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-46ea963a-97ef-4d70-8a6d-06748bdb4ee4 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "GET /compute/v2.1/servers/7bae9245-118c-4121-b43a-307dd6046a75" status: 200 len: 1266 microversion: 2.1 time: 0.257290 Jun 07 14:49:57.511904 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 513/1036] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:49:57 2022] GET /compute/v2.1/servers/7bae9245-118c-4121-b43a-307dd6046a75 => generated 1266 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:49:58.534349 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-b0cca6c2-0787-4a60-9328-4022d0ada01b tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:58.534971 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-b0cca6c2-0787-4a60-9328-4022d0ada01b tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: 7bae9245-118c-4121-b43a-307dd6046a75] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:58.542707 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-b0cca6c2-0787-4a60-9328-4022d0ada01b tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:58.543296 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-b0cca6c2-0787-4a60-9328-4022d0ada01b tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:58.544272 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-b0cca6c2-0787-4a60-9328-4022d0ada01b tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:58.544930 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-b0cca6c2-0787-4a60-9328-4022d0ada01b tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:58.722864 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-b0cca6c2-0787-4a60-9328-4022d0ada01b tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15f5fa82414bdf8ca3f6723c0a8d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e877695d0f46339cb4b9b86aac3662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:58.730429 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-b0cca6c2-0787-4a60-9328-4022d0ada01b tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "GET /compute/v2.1/servers/7bae9245-118c-4121-b43a-307dd6046a75" status: 200 len: 1266 microversion: 2.1 time: 0.200572 Jun 07 14:49:58.731237 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 524/1037] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:49:58 2022] GET /compute/v2.1/servers/7bae9245-118c-4121-b43a-307dd6046a75 => generated 1266 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:49:58.812529 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [req-f4d67bae-03a1-4873-9bf4-e5900bef7c2f req-a4173b13-b5b8-4f77-ac5c-ef35e8fbcff9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75e38ceb-ae6e-456f-968b-90e5f4f39d37", "tag": "7b71f53f-1ebd-4fef-9f3d-7b046f3f3a49"}]} {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:49:58.830514 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [req-f4d67bae-03a1-4873-9bf4-e5900bef7c2f req-a4173b13-b5b8-4f77-ac5c-ef35e8fbcff9 service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:58.836937 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [req-f4d67bae-03a1-4873-9bf4-e5900bef7c2f req-a4173b13-b5b8-4f77-ac5c-ef35e8fbcff9 service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:58.849844 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.compute.server_external_events [req-f4d67bae-03a1-4873-9bf4-e5900bef7c2f req-a4173b13-b5b8-4f77-ac5c-ef35e8fbcff9 service nova] Creating event network-changed:7b71f53f-1ebd-4fef-9f3d-7b046f3f3a49 for instance 75e38ceb-ae6e-456f-968b-90e5f4f39d37 on hv-cinder-84497 Jun 07 14:49:58.855299 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [req-f4d67bae-03a1-4873-9bf4-e5900bef7c2f req-a4173b13-b5b8-4f77-ac5c-ef35e8fbcff9 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047069 Jun 07 14:49:58.863000 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 514/1038] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jun 7 14:49:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:49:59.747198 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-d4884f67-846b-4a60-8272-dff2cab8ba91 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:49:59.747820 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-d4884f67-846b-4a60-8272-dff2cab8ba91 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: 7bae9245-118c-4121-b43a-307dd6046a75] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:49:59.751363 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG dbcounter [-] [118158] Writing DB stats nova_api:SELECT=74 {{(pid=118158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:49:59.755016 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-d4884f67-846b-4a60-8272-dff2cab8ba91 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:59.755480 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-d4884f67-846b-4a60-8272-dff2cab8ba91 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:59.756270 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-d4884f67-846b-4a60-8272-dff2cab8ba91 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:49:59.756749 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-d4884f67-846b-4a60-8272-dff2cab8ba91 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:49:59.949370 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-d4884f67-846b-4a60-8272-dff2cab8ba91 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15f5fa82414bdf8ca3f6723c0a8d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e877695d0f46339cb4b9b86aac3662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:49:59.963451 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-d4884f67-846b-4a60-8272-dff2cab8ba91 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "GET /compute/v2.1/servers/7bae9245-118c-4121-b43a-307dd6046a75" status: 200 len: 1266 microversion: 2.1 time: 0.219983 Jun 07 14:49:59.968750 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 525/1039] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:49:59 2022] GET /compute/v2.1/servers/7bae9245-118c-4121-b43a-307dd6046a75 => generated 1266 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:50:00.987237 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-12086069-2fda-4e87-a49c-55664b33e370 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:50:00.988113 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-12086069-2fda-4e87-a49c-55664b33e370 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: 7bae9245-118c-4121-b43a-307dd6046a75] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:50:00.995046 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-12086069-2fda-4e87-a49c-55664b33e370 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:50:00.996003 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-12086069-2fda-4e87-a49c-55664b33e370 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:50:00.997125 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-12086069-2fda-4e87-a49c-55664b33e370 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:50:00.998017 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-12086069-2fda-4e87-a49c-55664b33e370 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:50:01.260980 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-12086069-2fda-4e87-a49c-55664b33e370 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15f5fa82414bdf8ca3f6723c0a8d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e877695d0f46339cb4b9b86aac3662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:50:01.273176 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-12086069-2fda-4e87-a49c-55664b33e370 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "GET /compute/v2.1/servers/7bae9245-118c-4121-b43a-307dd6046a75" status: 200 len: 1266 microversion: 2.1 time: 0.290648 Jun 07 14:50:01.274451 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 515/1040] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:50:00 2022] GET /compute/v2.1/servers/7bae9245-118c-4121-b43a-307dd6046a75 => generated 1266 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:50:01.516990 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-5a37b6f4-4319-41bf-bfc2-98b96dc0c832 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1845075276"}} {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:50:01.517642 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-5a37b6f4-4319-41bf-bfc2-98b96dc0c832 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] [instance: 75e38ceb-ae6e-456f-968b-90e5f4f39d37] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:50:01.529137 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5a37b6f4-4319-41bf-bfc2-98b96dc0c832 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:50:01.529719 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5a37b6f4-4319-41bf-bfc2-98b96dc0c832 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:50:01.530518 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5a37b6f4-4319-41bf-bfc2-98b96dc0c832 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:50:01.532349 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5a37b6f4-4319-41bf-bfc2-98b96dc0c832 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:50:01.667569 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.network.security_group_api [None req-5a37b6f4-4319-41bf-bfc2-98b96dc0c832 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Adding security group 8790045f-6a34-42ba-8631-5ab6ccf433e8 to port 7b71f53f-1ebd-4fef-9f3d-7b046f3f3a49 Jun 07 14:50:02.173909 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-5a37b6f4-4319-41bf-bfc2-98b96dc0c832 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] 10.222.0.85 "POST /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37/action" status: 202 len: 0 microversion: 2.1 time: 0.659975 Jun 07 14:50:02.179693 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 526/1041] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Jun 7 14:50:01 2022] POST /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37/action => generated 0 bytes in 668 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 14:50:02.185062 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [req-2900f9dc-5670-42ba-8feb-cddf8624e275 req-ed70e531-707c-4c25-b414-6e2c70729a1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75e38ceb-ae6e-456f-968b-90e5f4f39d37", "tag": "7b71f53f-1ebd-4fef-9f3d-7b046f3f3a49"}]} {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:50:02.191811 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-41dabe7b-9e1a-4870-9c04-ac7fcacdf2fd tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:50:02.193770 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-41dabe7b-9e1a-4870-9c04-ac7fcacdf2fd tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] [instance: 75e38ceb-ae6e-456f-968b-90e5f4f39d37] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:50:02.203613 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [req-2900f9dc-5670-42ba-8feb-cddf8624e275 req-ed70e531-707c-4c25-b414-6e2c70729a1b service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:50:02.204339 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [req-2900f9dc-5670-42ba-8feb-cddf8624e275 req-ed70e531-707c-4c25-b414-6e2c70729a1b service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:50:02.207822 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-41dabe7b-9e1a-4870-9c04-ac7fcacdf2fd tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:50:02.208394 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-41dabe7b-9e1a-4870-9c04-ac7fcacdf2fd tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:50:02.209269 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-41dabe7b-9e1a-4870-9c04-ac7fcacdf2fd tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:50:02.210028 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-41dabe7b-9e1a-4870-9c04-ac7fcacdf2fd tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:50:02.301490 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.compute.server_external_events [req-2900f9dc-5670-42ba-8feb-cddf8624e275 req-ed70e531-707c-4c25-b414-6e2c70729a1b service nova] Creating event network-changed:7b71f53f-1ebd-4fef-9f3d-7b046f3f3a49 for instance 75e38ceb-ae6e-456f-968b-90e5f4f39d37 on hv-cinder-84497 Jun 07 14:50:02.309340 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [req-2900f9dc-5670-42ba-8feb-cddf8624e275 req-ed70e531-707c-4c25-b414-6e2c70729a1b service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128147 Jun 07 14:50:02.311319 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 516/1042] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jun 7 14:50:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:50:02.321115 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-767975f3-6750-4207-985c-0e5254dce901 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:50:02.322224 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-767975f3-6750-4207-985c-0e5254dce901 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: 7bae9245-118c-4121-b43a-307dd6046a75] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:50:02.344246 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-767975f3-6750-4207-985c-0e5254dce901 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:50:02.345228 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-767975f3-6750-4207-985c-0e5254dce901 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:50:02.346426 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-767975f3-6750-4207-985c-0e5254dce901 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:50:02.347050 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-767975f3-6750-4207-985c-0e5254dce901 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:50:02.543759 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-41dabe7b-9e1a-4870-9c04-ac7fcacdf2fd tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b3f5c080034b658cbfb311c0c77b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b63567b3e54cf1a4348fb65b65a040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:50:02.554332 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-41dabe7b-9e1a-4870-9c04-ac7fcacdf2fd tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] 10.222.0.85 "GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37" status: 200 len: 1762 microversion: 2.1 time: 0.372579 Jun 07 14:50:02.557182 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 527/1043] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:50:02 2022] GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37 => generated 1762 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:50:02.621600 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-767975f3-6750-4207-985c-0e5254dce901 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15f5fa82414bdf8ca3f6723c0a8d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e877695d0f46339cb4b9b86aac3662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:50:02.632179 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-767975f3-6750-4207-985c-0e5254dce901 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "GET /compute/v2.1/servers/7bae9245-118c-4121-b43a-307dd6046a75" status: 200 len: 1266 microversion: 2.1 time: 0.319171 Jun 07 14:50:02.634888 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 517/1044] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:50:02 2022] GET /compute/v2.1/servers/7bae9245-118c-4121-b43a-307dd6046a75 => generated 1266 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:50:03.651790 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-d49401b3-1916-4c05-af9b-f41c230bef42 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:50:03.652518 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-d49401b3-1916-4c05-af9b-f41c230bef42 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: 7bae9245-118c-4121-b43a-307dd6046a75] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:50:03.659029 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-d49401b3-1916-4c05-af9b-f41c230bef42 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:50:03.659483 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-d49401b3-1916-4c05-af9b-f41c230bef42 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:50:03.660251 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-d49401b3-1916-4c05-af9b-f41c230bef42 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:50:03.660716 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-d49401b3-1916-4c05-af9b-f41c230bef42 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:50:03.803533 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-d49401b3-1916-4c05-af9b-f41c230bef42 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15f5fa82414bdf8ca3f6723c0a8d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e877695d0f46339cb4b9b86aac3662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:50:03.809416 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-d49401b3-1916-4c05-af9b-f41c230bef42 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "GET /compute/v2.1/servers/7bae9245-118c-4121-b43a-307dd6046a75" status: 200 len: 1266 microversion: 2.1 time: 0.162021 Jun 07 14:50:03.809981 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 528/1045] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:50:03 2022] GET /compute/v2.1/servers/7bae9245-118c-4121-b43a-307dd6046a75 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:50:04.826697 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-56c5f985-df3b-4030-b4ba-7d5f15d21412 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:50:04.827343 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-56c5f985-df3b-4030-b4ba-7d5f15d21412 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: 7bae9245-118c-4121-b43a-307dd6046a75] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:50:04.834125 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-56c5f985-df3b-4030-b4ba-7d5f15d21412 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:50:04.834580 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-56c5f985-df3b-4030-b4ba-7d5f15d21412 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:50:04.835421 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-56c5f985-df3b-4030-b4ba-7d5f15d21412 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:50:04.835859 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-56c5f985-df3b-4030-b4ba-7d5f15d21412 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:50:04.986979 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-56c5f985-df3b-4030-b4ba-7d5f15d21412 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15f5fa82414bdf8ca3f6723c0a8d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e877695d0f46339cb4b9b86aac3662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:50:04.998768 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-56c5f985-df3b-4030-b4ba-7d5f15d21412 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "GET /compute/v2.1/servers/7bae9245-118c-4121-b43a-307dd6046a75" status: 200 len: 1266 microversion: 2.1 time: 0.176566 Jun 07 14:50:04.999414 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 518/1046] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:50:04 2022] GET /compute/v2.1/servers/7bae9245-118c-4121-b43a-307dd6046a75 => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:50:06.015922 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-ad636683-55b5-45a1-8f6e-a55bfa9dc11e tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:50:06.016580 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-ad636683-55b5-45a1-8f6e-a55bfa9dc11e tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: 7bae9245-118c-4121-b43a-307dd6046a75] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:50:06.023113 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-ad636683-55b5-45a1-8f6e-a55bfa9dc11e tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:50:06.023562 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-ad636683-55b5-45a1-8f6e-a55bfa9dc11e tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:50:06.024328 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-ad636683-55b5-45a1-8f6e-a55bfa9dc11e tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:50:06.024793 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-ad636683-55b5-45a1-8f6e-a55bfa9dc11e tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:50:06.157661 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-ad636683-55b5-45a1-8f6e-a55bfa9dc11e tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15f5fa82414bdf8ca3f6723c0a8d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e877695d0f46339cb4b9b86aac3662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:50:06.165091 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-ad636683-55b5-45a1-8f6e-a55bfa9dc11e tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "GET /compute/v2.1/servers/7bae9245-118c-4121-b43a-307dd6046a75" status: 200 len: 1266 microversion: 2.1 time: 0.153607 Jun 07 14:50:06.165648 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 529/1047] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:50:06 2022] GET /compute/v2.1/servers/7bae9245-118c-4121-b43a-307dd6046a75 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:50:06.886159 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-5424e340-d284-4c9f-995c-f93af617238b tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:50:06.886702 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-5424e340-d284-4c9f-995c-f93af617238b tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 46299ff5-499b-4ec8-b2d5-f876e3303a07] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:50:06.892842 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-5424e340-d284-4c9f-995c-f93af617238b tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:50:06.893294 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-5424e340-d284-4c9f-995c-f93af617238b tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:50:06.894204 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-5424e340-d284-4c9f-995c-f93af617238b tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:50:06.894682 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-5424e340-d284-4c9f-995c-f93af617238b tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:50:06.978094 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.objects.instance [None req-5424e340-d284-4c9f-995c-f93af617238b tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lazy-loading 'services' on Instance uuid 46299ff5-499b-4ec8-b2d5-f876e3303a07 {{(pid=118157) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 14:50:07.181339 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-f76060b7-c2a8-4f63-b050-ce6f1d03bacc tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:50:07.181907 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-f76060b7-c2a8-4f63-b050-ce6f1d03bacc tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: 7bae9245-118c-4121-b43a-307dd6046a75] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:50:07.188515 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-f76060b7-c2a8-4f63-b050-ce6f1d03bacc tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:50:07.188966 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-f76060b7-c2a8-4f63-b050-ce6f1d03bacc tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:50:07.189735 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-f76060b7-c2a8-4f63-b050-ce6f1d03bacc tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:50:07.190209 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-f76060b7-c2a8-4f63-b050-ce6f1d03bacc tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:50:07.203628 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-5424e340-d284-4c9f-995c-f93af617238b tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "DELETE /compute/v2.1/servers/46299ff5-499b-4ec8-b2d5-f876e3303a07/os-volume_attachments/6fbe22e2-ecbf-4ffd-bab1-000b49a288ca" status: 202 len: 0 microversion: 2.1 time: 0.321727 Jun 07 14:50:07.204275 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 519/1048] 10.222.0.85 () {58 vars in 1415 bytes} [Tue Jun 7 14:50:06 2022] DELETE /compute/v2.1/servers/46299ff5-499b-4ec8-b2d5-f876e3303a07/os-volume_attachments/6fbe22e2-ecbf-4ffd-bab1-000b49a288ca => generated 0 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 14:50:07.213101 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-607639d9-ef88-4e7e-a1c8-c2cd6cdfb8c0 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:50:07.214122 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-607639d9-ef88-4e7e-a1c8-c2cd6cdfb8c0 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 46299ff5-499b-4ec8-b2d5-f876e3303a07] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:50:07.220977 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-607639d9-ef88-4e7e-a1c8-c2cd6cdfb8c0 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:50:07.221423 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-607639d9-ef88-4e7e-a1c8-c2cd6cdfb8c0 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:50:07.222215 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-607639d9-ef88-4e7e-a1c8-c2cd6cdfb8c0 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:50:07.222649 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-607639d9-ef88-4e7e-a1c8-c2cd6cdfb8c0 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:50:07.254766 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-607639d9-ef88-4e7e-a1c8-c2cd6cdfb8c0 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/46299ff5-499b-4ec8-b2d5-f876e3303a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045946 Jun 07 14:50:07.255549 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 520/1049] 10.222.0.85 () {58 vars in 1301 bytes} [Tue Jun 7 14:50:07 2022] GET /compute/v2.1/servers/46299ff5-499b-4ec8-b2d5-f876e3303a07/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 14:50:07.337386 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-f76060b7-c2a8-4f63-b050-ce6f1d03bacc tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15f5fa82414bdf8ca3f6723c0a8d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e877695d0f46339cb4b9b86aac3662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:50:07.347098 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-f76060b7-c2a8-4f63-b050-ce6f1d03bacc tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "GET /compute/v2.1/servers/7bae9245-118c-4121-b43a-307dd6046a75" status: 200 len: 1266 microversion: 2.1 time: 0.169650 Jun 07 14:50:07.347660 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 530/1050] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:50:07 2022] GET /compute/v2.1/servers/7bae9245-118c-4121-b43a-307dd6046a75 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:50:08.267346 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-a305d1bc-6007-4897-9c48-2fe2e8510b3a tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:50:08.268198 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-a305d1bc-6007-4897-9c48-2fe2e8510b3a tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 46299ff5-499b-4ec8-b2d5-f876e3303a07] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:50:08.274691 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-a305d1bc-6007-4897-9c48-2fe2e8510b3a tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:50:08.275402 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-a305d1bc-6007-4897-9c48-2fe2e8510b3a tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:50:08.276167 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-a305d1bc-6007-4897-9c48-2fe2e8510b3a tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:50:08.276628 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-a305d1bc-6007-4897-9c48-2fe2e8510b3a tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:50:08.305153 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-a305d1bc-6007-4897-9c48-2fe2e8510b3a tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/46299ff5-499b-4ec8-b2d5-f876e3303a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041813 Jun 07 14:50:08.305698 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 521/1051] 10.222.0.85 () {58 vars in 1301 bytes} [Tue Jun 7 14:50:08 2022] GET /compute/v2.1/servers/46299ff5-499b-4ec8-b2d5-f876e3303a07/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:50:08.363287 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-4e784126-c2b2-46c0-b49b-0f3974e0ebd4 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:50:08.363893 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-4e784126-c2b2-46c0-b49b-0f3974e0ebd4 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: 7bae9245-118c-4121-b43a-307dd6046a75] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:50:08.370409 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-4e784126-c2b2-46c0-b49b-0f3974e0ebd4 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:50:08.371408 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-4e784126-c2b2-46c0-b49b-0f3974e0ebd4 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:50:08.372173 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-4e784126-c2b2-46c0-b49b-0f3974e0ebd4 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:50:08.372853 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-4e784126-c2b2-46c0-b49b-0f3974e0ebd4 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:50:08.517214 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-4e784126-c2b2-46c0-b49b-0f3974e0ebd4 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15f5fa82414bdf8ca3f6723c0a8d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e877695d0f46339cb4b9b86aac3662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:50:08.524987 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-4e784126-c2b2-46c0-b49b-0f3974e0ebd4 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "GET /compute/v2.1/servers/7bae9245-118c-4121-b43a-307dd6046a75" status: 200 len: 1266 microversion: 2.1 time: 0.165689 Jun 07 14:50:08.525719 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 531/1052] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:50:08 2022] GET /compute/v2.1/servers/7bae9245-118c-4121-b43a-307dd6046a75 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:50:09.316496 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-a3877606-108e-45fb-995c-ba03aa93bd5e tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:50:09.317502 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-a3877606-108e-45fb-995c-ba03aa93bd5e tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 46299ff5-499b-4ec8-b2d5-f876e3303a07] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:50:09.324087 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-a3877606-108e-45fb-995c-ba03aa93bd5e tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:50:09.324593 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-a3877606-108e-45fb-995c-ba03aa93bd5e tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:50:09.325370 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-a3877606-108e-45fb-995c-ba03aa93bd5e tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:50:09.325814 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-a3877606-108e-45fb-995c-ba03aa93bd5e tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:50:09.357066 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-a3877606-108e-45fb-995c-ba03aa93bd5e tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/46299ff5-499b-4ec8-b2d5-f876e3303a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044447 Jun 07 14:50:09.357633 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 522/1053] 10.222.0.85 () {58 vars in 1301 bytes} [Tue Jun 7 14:50:09 2022] GET /compute/v2.1/servers/46299ff5-499b-4ec8-b2d5-f876e3303a07/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:50:09.541960 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-d91893a1-3c07-4afa-8e3a-f55d636804d5 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:50:09.542597 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-d91893a1-3c07-4afa-8e3a-f55d636804d5 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: 7bae9245-118c-4121-b43a-307dd6046a75] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:50:09.549269 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-d91893a1-3c07-4afa-8e3a-f55d636804d5 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:50:09.550188 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-d91893a1-3c07-4afa-8e3a-f55d636804d5 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:50:09.550505 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-d91893a1-3c07-4afa-8e3a-f55d636804d5 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:50:09.550914 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-d91893a1-3c07-4afa-8e3a-f55d636804d5 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:50:09.702225 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-d91893a1-3c07-4afa-8e3a-f55d636804d5 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15f5fa82414bdf8ca3f6723c0a8d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e877695d0f46339cb4b9b86aac3662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:50:09.706380 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG dbcounter [-] [118158] Writing DB stats nova_cell1:SELECT=100 {{(pid=118158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:50:09.711238 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-d91893a1-3c07-4afa-8e3a-f55d636804d5 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "GET /compute/v2.1/servers/7bae9245-118c-4121-b43a-307dd6046a75" status: 200 len: 1266 microversion: 2.1 time: 0.173196 Jun 07 14:50:09.711861 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 532/1054] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:50:09 2022] GET /compute/v2.1/servers/7bae9245-118c-4121-b43a-307dd6046a75 => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:50:10.369149 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-8ffcb9c8-2889-4093-a297-f987c701758d tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:50:10.370065 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-8ffcb9c8-2889-4093-a297-f987c701758d tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 46299ff5-499b-4ec8-b2d5-f876e3303a07] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:50:10.377320 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-8ffcb9c8-2889-4093-a297-f987c701758d tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:50:10.377777 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-8ffcb9c8-2889-4093-a297-f987c701758d tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:50:10.378556 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-8ffcb9c8-2889-4093-a297-f987c701758d tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:50:10.378998 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-8ffcb9c8-2889-4093-a297-f987c701758d tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:50:10.408705 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-8ffcb9c8-2889-4093-a297-f987c701758d tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/46299ff5-499b-4ec8-b2d5-f876e3303a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043599 Jun 07 14:50:10.409256 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 523/1055] 10.222.0.85 () {58 vars in 1301 bytes} [Tue Jun 7 14:50:10 2022] GET /compute/v2.1/servers/46299ff5-499b-4ec8-b2d5-f876e3303a07/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:50:10.734947 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-3e08ca98-65d9-41fe-960c-1453ad197820 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:50:10.735543 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-3e08ca98-65d9-41fe-960c-1453ad197820 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: 7bae9245-118c-4121-b43a-307dd6046a75] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:50:10.742320 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-3e08ca98-65d9-41fe-960c-1453ad197820 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:50:10.742777 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-3e08ca98-65d9-41fe-960c-1453ad197820 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:50:10.743645 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-3e08ca98-65d9-41fe-960c-1453ad197820 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:50:10.744084 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-3e08ca98-65d9-41fe-960c-1453ad197820 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:50:10.884307 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-3e08ca98-65d9-41fe-960c-1453ad197820 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15f5fa82414bdf8ca3f6723c0a8d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e877695d0f46339cb4b9b86aac3662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:50:10.892279 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-3e08ca98-65d9-41fe-960c-1453ad197820 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "GET /compute/v2.1/servers/7bae9245-118c-4121-b43a-307dd6046a75" status: 200 len: 1266 microversion: 2.1 time: 0.162066 Jun 07 14:50:10.892894 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 533/1056] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:50:10 2022] GET /compute/v2.1/servers/7bae9245-118c-4121-b43a-307dd6046a75 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:50:11.421546 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-63a52f92-4315-44bf-93bf-bc9711fe27e3 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:50:11.422471 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-63a52f92-4315-44bf-93bf-bc9711fe27e3 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 46299ff5-499b-4ec8-b2d5-f876e3303a07] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:50:11.429115 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-63a52f92-4315-44bf-93bf-bc9711fe27e3 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:50:11.429560 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-63a52f92-4315-44bf-93bf-bc9711fe27e3 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:50:11.430323 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-63a52f92-4315-44bf-93bf-bc9711fe27e3 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:50:11.430754 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-63a52f92-4315-44bf-93bf-bc9711fe27e3 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:50:11.461149 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-63a52f92-4315-44bf-93bf-bc9711fe27e3 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/46299ff5-499b-4ec8-b2d5-f876e3303a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043493 Jun 07 14:50:11.461699 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 524/1057] 10.222.0.85 () {58 vars in 1301 bytes} [Tue Jun 7 14:50:11 2022] GET /compute/v2.1/servers/46299ff5-499b-4ec8-b2d5-f876e3303a07/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 14:50:11.909493 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-93c686ad-bd62-44ed-a794-bf0cf74c64a4 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:50:11.910180 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-93c686ad-bd62-44ed-a794-bf0cf74c64a4 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: 7bae9245-118c-4121-b43a-307dd6046a75] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:50:11.916787 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-93c686ad-bd62-44ed-a794-bf0cf74c64a4 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:50:11.917337 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-93c686ad-bd62-44ed-a794-bf0cf74c64a4 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:50:11.918687 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-93c686ad-bd62-44ed-a794-bf0cf74c64a4 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:50:11.919125 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-93c686ad-bd62-44ed-a794-bf0cf74c64a4 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:50:12.062280 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-93c686ad-bd62-44ed-a794-bf0cf74c64a4 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15f5fa82414bdf8ca3f6723c0a8d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e877695d0f46339cb4b9b86aac3662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:50:12.074780 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-93c686ad-bd62-44ed-a794-bf0cf74c64a4 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "GET /compute/v2.1/servers/7bae9245-118c-4121-b43a-307dd6046a75" status: 200 len: 1266 microversion: 2.1 time: 0.169153 Jun 07 14:50:12.075691 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 534/1058] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:50:11 2022] GET /compute/v2.1/servers/7bae9245-118c-4121-b43a-307dd6046a75 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:50:12.472856 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-afb44214-ec21-4ac5-90df-7c60ff88a0b0 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:50:12.473784 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-afb44214-ec21-4ac5-90df-7c60ff88a0b0 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 46299ff5-499b-4ec8-b2d5-f876e3303a07] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:50:12.480200 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-afb44214-ec21-4ac5-90df-7c60ff88a0b0 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:50:12.481341 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-afb44214-ec21-4ac5-90df-7c60ff88a0b0 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:50:12.482103 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-afb44214-ec21-4ac5-90df-7c60ff88a0b0 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:50:12.482541 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-afb44214-ec21-4ac5-90df-7c60ff88a0b0 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:50:12.507588 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG dbcounter [-] [118157] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:50:12.512193 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-afb44214-ec21-4ac5-90df-7c60ff88a0b0 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/46299ff5-499b-4ec8-b2d5-f876e3303a07/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042945 Jun 07 14:50:12.512790 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 525/1059] 10.222.0.85 () {58 vars in 1301 bytes} [Tue Jun 7 14:50:12 2022] GET /compute/v2.1/servers/46299ff5-499b-4ec8-b2d5-f876e3303a07/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 07 14:50:12.584242 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-b4de9dda-afc8-459c-a725-fdb031bd0d6f tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:50:12.584768 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-b4de9dda-afc8-459c-a725-fdb031bd0d6f tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 46299ff5-499b-4ec8-b2d5-f876e3303a07] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:50:12.591450 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-b4de9dda-afc8-459c-a725-fdb031bd0d6f tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:50:12.591905 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-b4de9dda-afc8-459c-a725-fdb031bd0d6f tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:50:12.592706 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-b4de9dda-afc8-459c-a725-fdb031bd0d6f tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:50:12.593161 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-b4de9dda-afc8-459c-a725-fdb031bd0d6f tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:50:12.617380 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-b4de9dda-afc8-459c-a725-fdb031bd0d6f tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 46299ff5-499b-4ec8-b2d5-f876e3303a07] Going to try to terminate instance {{(pid=118158) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 14:50:12.939223 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-b4de9dda-afc8-459c-a725-fdb031bd0d6f tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "DELETE /compute/v2.1/servers/46299ff5-499b-4ec8-b2d5-f876e3303a07" status: 204 len: 0 microversion: 2.1 time: 0.358234 Jun 07 14:50:12.939930 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 535/1060] 10.222.0.85 () {58 vars in 1238 bytes} [Tue Jun 7 14:50:12 2022] DELETE /compute/v2.1/servers/46299ff5-499b-4ec8-b2d5-f876e3303a07 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 14:50:12.948660 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-c78e6acc-3cf9-42b2-bb0a-7763d1139342 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:50:12.949926 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-c78e6acc-3cf9-42b2-bb0a-7763d1139342 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 46299ff5-499b-4ec8-b2d5-f876e3303a07] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:50:12.957216 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-c78e6acc-3cf9-42b2-bb0a-7763d1139342 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:50:12.957672 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-c78e6acc-3cf9-42b2-bb0a-7763d1139342 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:50:12.958457 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-c78e6acc-3cf9-42b2-bb0a-7763d1139342 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:50:12.958898 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-c78e6acc-3cf9-42b2-bb0a-7763d1139342 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:50:13.093829 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-28987e32-d2c9-436d-bb91-033dcc19edac tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:50:13.094919 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-28987e32-d2c9-436d-bb91-033dcc19edac tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: 7bae9245-118c-4121-b43a-307dd6046a75] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:50:13.103309 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-28987e32-d2c9-436d-bb91-033dcc19edac tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:50:13.104124 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-28987e32-d2c9-436d-bb91-033dcc19edac tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:50:13.105659 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-28987e32-d2c9-436d-bb91-033dcc19edac tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:50:13.106805 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-28987e32-d2c9-436d-bb91-033dcc19edac tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:50:13.114952 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-c78e6acc-3cf9-42b2-bb0a-7763d1139342 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eb9ec1f3ff44bbb03cf934cb2a04de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eae64ee53144e4f8d583bb4288c0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:50:13.123907 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-c78e6acc-3cf9-42b2-bb0a-7763d1139342 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/46299ff5-499b-4ec8-b2d5-f876e3303a07" status: 200 len: 1680 microversion: 2.1 time: 0.179137 Jun 07 14:50:13.125065 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 526/1061] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:50:12 2022] GET /compute/v2.1/servers/46299ff5-499b-4ec8-b2d5-f876e3303a07 => generated 1680 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:50:13.264662 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-28987e32-d2c9-436d-bb91-033dcc19edac tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15f5fa82414bdf8ca3f6723c0a8d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e877695d0f46339cb4b9b86aac3662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:50:13.273497 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-28987e32-d2c9-436d-bb91-033dcc19edac tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "GET /compute/v2.1/servers/7bae9245-118c-4121-b43a-307dd6046a75" status: 200 len: 1266 microversion: 2.1 time: 0.185583 Jun 07 14:50:13.274074 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 536/1062] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:50:13 2022] GET /compute/v2.1/servers/7bae9245-118c-4121-b43a-307dd6046a75 => generated 1266 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:50:13.444219 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [req-9327a19b-9c91-49fb-ae18-c5127661b22c req-c03f2321-4c36-48e6-b871-19b8f0ee91ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bae9245-118c-4121-b43a-307dd6046a75", "name": "network-vif-plugged", "status": "completed", "tag": "d401233f-31c8-4f31-89d5-7671349fd7e0"}]} {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:50:13.453195 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [req-9327a19b-9c91-49fb-ae18-c5127661b22c req-c03f2321-4c36-48e6-b871-19b8f0ee91ed service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:50:13.453652 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [req-9327a19b-9c91-49fb-ae18-c5127661b22c req-c03f2321-4c36-48e6-b871-19b8f0ee91ed service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:50:13.465201 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.compute.server_external_events [req-9327a19b-9c91-49fb-ae18-c5127661b22c req-c03f2321-4c36-48e6-b871-19b8f0ee91ed service nova] Creating event network-vif-plugged:d401233f-31c8-4f31-89d5-7671349fd7e0 for instance 7bae9245-118c-4121-b43a-307dd6046a75 on hv-cinder-84497 Jun 07 14:50:13.469992 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [req-9327a19b-9c91-49fb-ae18-c5127661b22c req-c03f2321-4c36-48e6-b871-19b8f0ee91ed service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152483 Jun 07 14:50:13.470798 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 527/1063] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jun 7 14:50:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:50:14.141673 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-2911a912-0ce2-4a3d-b342-6a68e80a16e0 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:50:14.142286 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-2911a912-0ce2-4a3d-b342-6a68e80a16e0 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 46299ff5-499b-4ec8-b2d5-f876e3303a07] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:50:14.149447 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-2911a912-0ce2-4a3d-b342-6a68e80a16e0 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:50:14.149895 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-2911a912-0ce2-4a3d-b342-6a68e80a16e0 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:50:14.151185 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-2911a912-0ce2-4a3d-b342-6a68e80a16e0 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:50:14.151661 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-2911a912-0ce2-4a3d-b342-6a68e80a16e0 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:50:14.281931 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-2911a912-0ce2-4a3d-b342-6a68e80a16e0 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eb9ec1f3ff44bbb03cf934cb2a04de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eae64ee53144e4f8d583bb4288c0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:50:14.289595 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-2911a912-0ce2-4a3d-b342-6a68e80a16e0 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/46299ff5-499b-4ec8-b2d5-f876e3303a07" status: 200 len: 1680 microversion: 2.1 time: 0.151808 Jun 07 14:50:14.290133 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 537/1064] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:50:14 2022] GET /compute/v2.1/servers/46299ff5-499b-4ec8-b2d5-f876e3303a07 => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:50:14.299686 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-fcccb779-a74b-407a-bf80-c22fc914b307 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:50:14.299686 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-fcccb779-a74b-407a-bf80-c22fc914b307 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: 7bae9245-118c-4121-b43a-307dd6046a75] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:50:14.299686 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-fcccb779-a74b-407a-bf80-c22fc914b307 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:50:14.299686 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-fcccb779-a74b-407a-bf80-c22fc914b307 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:50:14.300473 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-fcccb779-a74b-407a-bf80-c22fc914b307 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:50:14.300617 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-fcccb779-a74b-407a-bf80-c22fc914b307 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:50:14.433099 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-fcccb779-a74b-407a-bf80-c22fc914b307 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15f5fa82414bdf8ca3f6723c0a8d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e877695d0f46339cb4b9b86aac3662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:50:14.440687 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-fcccb779-a74b-407a-bf80-c22fc914b307 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "GET /compute/v2.1/servers/7bae9245-118c-4121-b43a-307dd6046a75" status: 200 len: 1266 microversion: 2.1 time: 0.154013 Jun 07 14:50:14.441260 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 528/1065] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:50:14 2022] GET /compute/v2.1/servers/7bae9245-118c-4121-b43a-307dd6046a75 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:50:15.306955 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-73d4d6f0-376c-467f-9d1a-a70a28d2e430 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:50:15.307480 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-73d4d6f0-376c-467f-9d1a-a70a28d2e430 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 46299ff5-499b-4ec8-b2d5-f876e3303a07] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:50:15.313945 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-73d4d6f0-376c-467f-9d1a-a70a28d2e430 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:50:15.314391 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-73d4d6f0-376c-467f-9d1a-a70a28d2e430 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:50:15.315143 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-73d4d6f0-376c-467f-9d1a-a70a28d2e430 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:50:15.315574 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-73d4d6f0-376c-467f-9d1a-a70a28d2e430 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:50:15.447864 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-73d4d6f0-376c-467f-9d1a-a70a28d2e430 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eb9ec1f3ff44bbb03cf934cb2a04de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eae64ee53144e4f8d583bb4288c0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:50:15.457381 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-73d4d6f0-376c-467f-9d1a-a70a28d2e430 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/46299ff5-499b-4ec8-b2d5-f876e3303a07" status: 200 len: 1680 microversion: 2.1 time: 0.154317 Jun 07 14:50:15.458297 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 538/1066] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:50:15 2022] GET /compute/v2.1/servers/46299ff5-499b-4ec8-b2d5-f876e3303a07 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:50:15.459658 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-cb103f5a-71c8-4fbd-9a62-28799bd26b8e tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:50:15.460033 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-cb103f5a-71c8-4fbd-9a62-28799bd26b8e tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: 7bae9245-118c-4121-b43a-307dd6046a75] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:50:15.467221 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-cb103f5a-71c8-4fbd-9a62-28799bd26b8e tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:50:15.468006 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-cb103f5a-71c8-4fbd-9a62-28799bd26b8e tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:50:15.468954 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-cb103f5a-71c8-4fbd-9a62-28799bd26b8e tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:50:15.472933 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-cb103f5a-71c8-4fbd-9a62-28799bd26b8e tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:50:15.602244 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-cb103f5a-71c8-4fbd-9a62-28799bd26b8e tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15f5fa82414bdf8ca3f6723c0a8d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e877695d0f46339cb4b9b86aac3662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:50:15.609732 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-cb103f5a-71c8-4fbd-9a62-28799bd26b8e tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "GET /compute/v2.1/servers/7bae9245-118c-4121-b43a-307dd6046a75" status: 200 len: 1266 microversion: 2.1 time: 0.154665 Jun 07 14:50:15.613997 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 529/1067] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:50:15 2022] GET /compute/v2.1/servers/7bae9245-118c-4121-b43a-307dd6046a75 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:50:16.475367 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-eed187d2-c524-48c1-b082-af0647970726 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:50:16.475980 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-eed187d2-c524-48c1-b082-af0647970726 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 46299ff5-499b-4ec8-b2d5-f876e3303a07] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:50:16.482531 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-eed187d2-c524-48c1-b082-af0647970726 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:50:16.482979 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-eed187d2-c524-48c1-b082-af0647970726 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:50:16.483737 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-eed187d2-c524-48c1-b082-af0647970726 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:50:16.484172 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-eed187d2-c524-48c1-b082-af0647970726 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:50:16.624160 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-eed187d2-c524-48c1-b082-af0647970726 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eb9ec1f3ff44bbb03cf934cb2a04de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eae64ee53144e4f8d583bb4288c0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:50:16.627026 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-554c3d6d-2d7d-451c-982a-ced5d88a3f0e tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:50:16.627655 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-554c3d6d-2d7d-451c-982a-ced5d88a3f0e tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: 7bae9245-118c-4121-b43a-307dd6046a75] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:50:16.631906 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-eed187d2-c524-48c1-b082-af0647970726 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/46299ff5-499b-4ec8-b2d5-f876e3303a07" status: 200 len: 1680 microversion: 2.1 time: 0.160609 Jun 07 14:50:16.632615 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 539/1068] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:50:16 2022] GET /compute/v2.1/servers/46299ff5-499b-4ec8-b2d5-f876e3303a07 => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:50:16.634804 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-554c3d6d-2d7d-451c-982a-ced5d88a3f0e tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:50:16.635263 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-554c3d6d-2d7d-451c-982a-ced5d88a3f0e tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:50:16.636058 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-554c3d6d-2d7d-451c-982a-ced5d88a3f0e tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:50:16.636536 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-554c3d6d-2d7d-451c-982a-ced5d88a3f0e tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:50:16.773131 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-554c3d6d-2d7d-451c-982a-ced5d88a3f0e tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15f5fa82414bdf8ca3f6723c0a8d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e877695d0f46339cb4b9b86aac3662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:50:16.781167 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-554c3d6d-2d7d-451c-982a-ced5d88a3f0e tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "GET /compute/v2.1/servers/7bae9245-118c-4121-b43a-307dd6046a75" status: 200 len: 1266 microversion: 2.1 time: 0.157827 Jun 07 14:50:16.781746 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 530/1069] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:50:16 2022] GET /compute/v2.1/servers/7bae9245-118c-4121-b43a-307dd6046a75 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:50:17.649783 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-a17bcc89-386b-48c2-8c7e-020d5b6e443a tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:50:17.650783 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-a17bcc89-386b-48c2-8c7e-020d5b6e443a tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 46299ff5-499b-4ec8-b2d5-f876e3303a07] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:50:17.657307 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-a17bcc89-386b-48c2-8c7e-020d5b6e443a tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:50:17.657756 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-a17bcc89-386b-48c2-8c7e-020d5b6e443a tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:50:17.658520 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-a17bcc89-386b-48c2-8c7e-020d5b6e443a tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:50:17.658960 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-a17bcc89-386b-48c2-8c7e-020d5b6e443a tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:50:17.792609 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-a17bcc89-386b-48c2-8c7e-020d5b6e443a tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eb9ec1f3ff44bbb03cf934cb2a04de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eae64ee53144e4f8d583bb4288c0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:50:17.797414 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-96e609ec-804c-44aa-95ab-4172341b15fb tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:50:17.798070 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-96e609ec-804c-44aa-95ab-4172341b15fb tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: 7bae9245-118c-4121-b43a-307dd6046a75] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:50:17.800996 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-a17bcc89-386b-48c2-8c7e-020d5b6e443a tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/46299ff5-499b-4ec8-b2d5-f876e3303a07" status: 200 len: 1680 microversion: 2.1 time: 0.155137 Jun 07 14:50:17.801661 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 540/1070] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:50:17 2022] GET /compute/v2.1/servers/46299ff5-499b-4ec8-b2d5-f876e3303a07 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:50:17.805396 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-96e609ec-804c-44aa-95ab-4172341b15fb tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:50:17.805781 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-96e609ec-804c-44aa-95ab-4172341b15fb tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:50:17.806559 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-96e609ec-804c-44aa-95ab-4172341b15fb tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:50:17.806999 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-96e609ec-804c-44aa-95ab-4172341b15fb tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:50:17.954424 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-96e609ec-804c-44aa-95ab-4172341b15fb tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15f5fa82414bdf8ca3f6723c0a8d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e877695d0f46339cb4b9b86aac3662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:50:17.965237 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-96e609ec-804c-44aa-95ab-4172341b15fb tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "GET /compute/v2.1/servers/7bae9245-118c-4121-b43a-307dd6046a75" status: 200 len: 1266 microversion: 2.1 time: 0.171568 Jun 07 14:50:17.966042 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 531/1071] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:50:17 2022] GET /compute/v2.1/servers/7bae9245-118c-4121-b43a-307dd6046a75 => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:50:18.817848 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-a1214c13-0019-4a75-b42e-48b5fec3d62b tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:50:18.818487 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-a1214c13-0019-4a75-b42e-48b5fec3d62b tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 46299ff5-499b-4ec8-b2d5-f876e3303a07] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:50:18.825146 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-a1214c13-0019-4a75-b42e-48b5fec3d62b tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:50:18.825621 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-a1214c13-0019-4a75-b42e-48b5fec3d62b tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:50:18.826386 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-a1214c13-0019-4a75-b42e-48b5fec3d62b tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:50:18.826871 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-a1214c13-0019-4a75-b42e-48b5fec3d62b tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:50:18.962580 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-a1214c13-0019-4a75-b42e-48b5fec3d62b tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eb9ec1f3ff44bbb03cf934cb2a04de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eae64ee53144e4f8d583bb4288c0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:50:18.970658 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-a1214c13-0019-4a75-b42e-48b5fec3d62b tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/46299ff5-499b-4ec8-b2d5-f876e3303a07" status: 200 len: 1680 microversion: 2.1 time: 0.156626 Jun 07 14:50:18.971257 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 541/1072] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:50:18 2022] GET /compute/v2.1/servers/46299ff5-499b-4ec8-b2d5-f876e3303a07 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:50:18.986453 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-f83e0294-6397-4a50-a1a6-bc03905ee476 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:50:18.987624 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-f83e0294-6397-4a50-a1a6-bc03905ee476 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: 7bae9245-118c-4121-b43a-307dd6046a75] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:50:18.995162 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-f83e0294-6397-4a50-a1a6-bc03905ee476 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:50:18.995542 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-f83e0294-6397-4a50-a1a6-bc03905ee476 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:50:18.996302 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-f83e0294-6397-4a50-a1a6-bc03905ee476 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:50:18.996811 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-f83e0294-6397-4a50-a1a6-bc03905ee476 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:50:19.139676 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-f83e0294-6397-4a50-a1a6-bc03905ee476 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15f5fa82414bdf8ca3f6723c0a8d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e877695d0f46339cb4b9b86aac3662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:50:19.149036 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-f83e0294-6397-4a50-a1a6-bc03905ee476 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "GET /compute/v2.1/servers/7bae9245-118c-4121-b43a-307dd6046a75" status: 200 len: 1266 microversion: 2.1 time: 0.169693 Jun 07 14:50:19.149604 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 532/1073] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:50:18 2022] GET /compute/v2.1/servers/7bae9245-118c-4121-b43a-307dd6046a75 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:50:19.996266 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-8823a19f-a7cd-48e4-8cad-356091eff380 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:50:19.996914 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-8823a19f-a7cd-48e4-8cad-356091eff380 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 46299ff5-499b-4ec8-b2d5-f876e3303a07] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:50:20.006318 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-8823a19f-a7cd-48e4-8cad-356091eff380 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:50:20.006769 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-8823a19f-a7cd-48e4-8cad-356091eff380 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:50:20.007547 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-8823a19f-a7cd-48e4-8cad-356091eff380 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:50:20.008018 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-8823a19f-a7cd-48e4-8cad-356091eff380 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:50:20.142392 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-8823a19f-a7cd-48e4-8cad-356091eff380 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eb9ec1f3ff44bbb03cf934cb2a04de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eae64ee53144e4f8d583bb4288c0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:50:20.147891 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-8823a19f-a7cd-48e4-8cad-356091eff380 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/46299ff5-499b-4ec8-b2d5-f876e3303a07" status: 200 len: 1680 microversion: 2.1 time: 0.155598 Jun 07 14:50:20.148497 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 542/1074] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:50:19 2022] GET /compute/v2.1/servers/46299ff5-499b-4ec8-b2d5-f876e3303a07 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:50:20.166904 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-e93d6603-8ad3-4c8e-9c84-77b21eab0da5 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:50:20.170727 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-e93d6603-8ad3-4c8e-9c84-77b21eab0da5 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: 7bae9245-118c-4121-b43a-307dd6046a75] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:50:20.175292 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-e93d6603-8ad3-4c8e-9c84-77b21eab0da5 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:50:20.175746 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-e93d6603-8ad3-4c8e-9c84-77b21eab0da5 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:50:20.176562 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-e93d6603-8ad3-4c8e-9c84-77b21eab0da5 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:50:20.177093 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-e93d6603-8ad3-4c8e-9c84-77b21eab0da5 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:50:20.351672 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-e93d6603-8ad3-4c8e-9c84-77b21eab0da5 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15f5fa82414bdf8ca3f6723c0a8d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e877695d0f46339cb4b9b86aac3662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:50:20.360161 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-e93d6603-8ad3-4c8e-9c84-77b21eab0da5 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "GET /compute/v2.1/servers/7bae9245-118c-4121-b43a-307dd6046a75" status: 200 len: 1266 microversion: 2.1 time: 0.197071 Jun 07 14:50:20.360754 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 533/1075] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:50:20 2022] GET /compute/v2.1/servers/7bae9245-118c-4121-b43a-307dd6046a75 => generated 1266 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:50:20.776303 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [req-73feb832-bfe6-49ea-b918-2b308bd5ff4b req-cda189b4-b3a3-4539-85f6-54da8df26aae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46299ff5-499b-4ec8-b2d5-f876e3303a07", "name": "network-vif-deleted", "tag": "67def1cd-fa4f-4a3a-80bf-96a2c73f57b0"}]} {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:50:20.786619 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [req-73feb832-bfe6-49ea-b918-2b308bd5ff4b req-cda189b4-b3a3-4539-85f6-54da8df26aae service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:50:20.787545 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [req-73feb832-bfe6-49ea-b918-2b308bd5ff4b req-cda189b4-b3a3-4539-85f6-54da8df26aae service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:50:20.801594 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.compute.server_external_events [req-73feb832-bfe6-49ea-b918-2b308bd5ff4b req-cda189b4-b3a3-4539-85f6-54da8df26aae service nova] Creating event network-vif-deleted:67def1cd-fa4f-4a3a-80bf-96a2c73f57b0 for instance 46299ff5-499b-4ec8-b2d5-f876e3303a07 on hv-cinder-84497 Jun 07 14:50:20.809543 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [req-73feb832-bfe6-49ea-b918-2b308bd5ff4b req-cda189b4-b3a3-4539-85f6-54da8df26aae service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042307 Jun 07 14:50:20.811233 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 543/1076] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jun 7 14:50:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:50:21.167011 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-4689c0c3-abcf-49be-8ce5-35b4f8df2dac tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:50:21.167582 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-4689c0c3-abcf-49be-8ce5-35b4f8df2dac tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 46299ff5-499b-4ec8-b2d5-f876e3303a07] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:50:21.178537 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-4689c0c3-abcf-49be-8ce5-35b4f8df2dac tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:50:21.179078 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-4689c0c3-abcf-49be-8ce5-35b4f8df2dac tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:50:21.180159 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-4689c0c3-abcf-49be-8ce5-35b4f8df2dac tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:50:21.181233 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-4689c0c3-abcf-49be-8ce5-35b4f8df2dac tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:50:21.216993 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-4689c0c3-abcf-49be-8ce5-35b4f8df2dac tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:50:21.217522 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-4689c0c3-abcf-49be-8ce5-35b4f8df2dac tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:50:21.218564 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.objects.instance [None req-4689c0c3-abcf-49be-8ce5-35b4f8df2dac tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lazy-loading 'fault' on Instance uuid 46299ff5-499b-4ec8-b2d5-f876e3303a07 {{(pid=118157) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 14:50:21.261786 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-4689c0c3-abcf-49be-8ce5-35b4f8df2dac tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eb9ec1f3ff44bbb03cf934cb2a04de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eae64ee53144e4f8d583bb4288c0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:50:21.270306 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-4689c0c3-abcf-49be-8ce5-35b4f8df2dac tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/46299ff5-499b-4ec8-b2d5-f876e3303a07" status: 200 len: 1331 microversion: 2.1 time: 0.107442 Jun 07 14:50:21.271511 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 534/1077] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:50:21 2022] GET /compute/v2.1/servers/46299ff5-499b-4ec8-b2d5-f876e3303a07 => generated 1331 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:50:21.378460 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-83f98f2a-9b0e-4daf-96ba-76872c213c16 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:50:21.379196 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-83f98f2a-9b0e-4daf-96ba-76872c213c16 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: 7bae9245-118c-4121-b43a-307dd6046a75] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:50:21.386011 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-83f98f2a-9b0e-4daf-96ba-76872c213c16 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:50:21.386466 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-83f98f2a-9b0e-4daf-96ba-76872c213c16 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:50:21.387244 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-83f98f2a-9b0e-4daf-96ba-76872c213c16 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:50:21.387680 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-83f98f2a-9b0e-4daf-96ba-76872c213c16 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:50:21.535163 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-83f98f2a-9b0e-4daf-96ba-76872c213c16 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15f5fa82414bdf8ca3f6723c0a8d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e877695d0f46339cb4b9b86aac3662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:50:21.542890 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-83f98f2a-9b0e-4daf-96ba-76872c213c16 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "GET /compute/v2.1/servers/7bae9245-118c-4121-b43a-307dd6046a75" status: 200 len: 1452 microversion: 2.1 time: 0.168725 Jun 07 14:50:21.543446 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 544/1078] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:50:21 2022] GET /compute/v2.1/servers/7bae9245-118c-4121-b43a-307dd6046a75 => generated 1452 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:50:21.559524 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-0a89a3a8-6ce4-442e-83e4-279fddc58946 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:50:21.560750 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-0a89a3a8-6ce4-442e-83e4-279fddc58946 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: 7bae9245-118c-4121-b43a-307dd6046a75] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:50:21.567163 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-0a89a3a8-6ce4-442e-83e4-279fddc58946 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:50:21.567611 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-0a89a3a8-6ce4-442e-83e4-279fddc58946 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:50:21.568451 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-0a89a3a8-6ce4-442e-83e4-279fddc58946 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:50:21.568892 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-0a89a3a8-6ce4-442e-83e4-279fddc58946 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:50:21.706145 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-0a89a3a8-6ce4-442e-83e4-279fddc58946 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15f5fa82414bdf8ca3f6723c0a8d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e877695d0f46339cb4b9b86aac3662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:50:21.714196 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-0a89a3a8-6ce4-442e-83e4-279fddc58946 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "GET /compute/v2.1/servers/7bae9245-118c-4121-b43a-307dd6046a75" status: 200 len: 1452 microversion: 2.1 time: 0.158521 Jun 07 14:50:21.714776 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 535/1079] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:50:21 2022] GET /compute/v2.1/servers/7bae9245-118c-4121-b43a-307dd6046a75 => generated 1452 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:50:22.288116 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-a945ac0d-1586-43be-8ebc-03f199f40181 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:50:22.288815 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-a945ac0d-1586-43be-8ebc-03f199f40181 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 46299ff5-499b-4ec8-b2d5-f876e3303a07] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:50:22.295257 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-a945ac0d-1586-43be-8ebc-03f199f40181 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:50:22.295706 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-a945ac0d-1586-43be-8ebc-03f199f40181 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:50:22.296491 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-a945ac0d-1586-43be-8ebc-03f199f40181 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:50:22.296928 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-a945ac0d-1586-43be-8ebc-03f199f40181 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:50:22.328242 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-a945ac0d-1586-43be-8ebc-03f199f40181 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:50:22.328729 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-a945ac0d-1586-43be-8ebc-03f199f40181 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:50:22.329181 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.objects.instance [None req-a945ac0d-1586-43be-8ebc-03f199f40181 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lazy-loading 'fault' on Instance uuid 46299ff5-499b-4ec8-b2d5-f876e3303a07 {{(pid=118158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 14:50:22.378938 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-a945ac0d-1586-43be-8ebc-03f199f40181 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eb9ec1f3ff44bbb03cf934cb2a04de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eae64ee53144e4f8d583bb4288c0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:50:22.386472 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-a945ac0d-1586-43be-8ebc-03f199f40181 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/46299ff5-499b-4ec8-b2d5-f876e3303a07" status: 200 len: 1331 microversion: 2.1 time: 0.102461 Jun 07 14:50:22.387035 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 545/1080] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:50:22 2022] GET /compute/v2.1/servers/46299ff5-499b-4ec8-b2d5-f876e3303a07 => generated 1331 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:50:23.403988 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-e69f72f0-9038-4b78-a2be-e5b26c4c6dfb tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:50:23.404642 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-e69f72f0-9038-4b78-a2be-e5b26c4c6dfb tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 46299ff5-499b-4ec8-b2d5-f876e3303a07] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:50:23.411155 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-e69f72f0-9038-4b78-a2be-e5b26c4c6dfb tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:50:23.411613 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-e69f72f0-9038-4b78-a2be-e5b26c4c6dfb tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:50:23.412391 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-e69f72f0-9038-4b78-a2be-e5b26c4c6dfb tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:50:23.412852 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-e69f72f0-9038-4b78-a2be-e5b26c4c6dfb tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:50:23.459632 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-e69f72f0-9038-4b78-a2be-e5b26c4c6dfb tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:50:23.460551 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-e69f72f0-9038-4b78-a2be-e5b26c4c6dfb tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:50:23.461368 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.objects.instance [None req-e69f72f0-9038-4b78-a2be-e5b26c4c6dfb tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lazy-loading 'fault' on Instance uuid 46299ff5-499b-4ec8-b2d5-f876e3303a07 {{(pid=118157) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 14:50:23.539496 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-e69f72f0-9038-4b78-a2be-e5b26c4c6dfb tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eb9ec1f3ff44bbb03cf934cb2a04de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eae64ee53144e4f8d583bb4288c0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:50:23.547053 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-e69f72f0-9038-4b78-a2be-e5b26c4c6dfb tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/46299ff5-499b-4ec8-b2d5-f876e3303a07" status: 200 len: 1331 microversion: 2.1 time: 0.147098 Jun 07 14:50:23.551499 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 536/1081] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:50:23 2022] GET /compute/v2.1/servers/46299ff5-499b-4ec8-b2d5-f876e3303a07 => generated 1331 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:50:24.088607 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [req-35934d85-de2d-4d41-85d5-3244c996f037 req-be556415-0373-4e77-a0d2-638ab994f37f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bae9245-118c-4121-b43a-307dd6046a75", "tag": "d401233f-31c8-4f31-89d5-7671349fd7e0"}]} {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:50:24.098170 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [req-35934d85-de2d-4d41-85d5-3244c996f037 req-be556415-0373-4e77-a0d2-638ab994f37f service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:50:24.103812 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [req-35934d85-de2d-4d41-85d5-3244c996f037 req-be556415-0373-4e77-a0d2-638ab994f37f service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:50:24.113048 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.compute.server_external_events [req-35934d85-de2d-4d41-85d5-3244c996f037 req-be556415-0373-4e77-a0d2-638ab994f37f service nova] Creating event network-changed:d401233f-31c8-4f31-89d5-7671349fd7e0 for instance 7bae9245-118c-4121-b43a-307dd6046a75 on hv-cinder-84497 Jun 07 14:50:24.118111 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [req-35934d85-de2d-4d41-85d5-3244c996f037 req-be556415-0373-4e77-a0d2-638ab994f37f service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033190 Jun 07 14:50:24.118721 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 546/1082] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jun 7 14:50:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:50:24.563760 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-314178fd-753a-4ff0-8454-27ca784ac469 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:50:24.564427 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-314178fd-753a-4ff0-8454-27ca784ac469 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 46299ff5-499b-4ec8-b2d5-f876e3303a07] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:50:24.570947 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-314178fd-753a-4ff0-8454-27ca784ac469 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:50:24.571404 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-314178fd-753a-4ff0-8454-27ca784ac469 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:50:24.572181 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-314178fd-753a-4ff0-8454-27ca784ac469 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:50:24.572644 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-314178fd-753a-4ff0-8454-27ca784ac469 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:50:24.604640 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-314178fd-753a-4ff0-8454-27ca784ac469 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:50:24.605018 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-314178fd-753a-4ff0-8454-27ca784ac469 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:50:24.605474 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.objects.instance [None req-314178fd-753a-4ff0-8454-27ca784ac469 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lazy-loading 'fault' on Instance uuid 46299ff5-499b-4ec8-b2d5-f876e3303a07 {{(pid=118157) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 14:50:24.647971 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-314178fd-753a-4ff0-8454-27ca784ac469 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eb9ec1f3ff44bbb03cf934cb2a04de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eae64ee53144e4f8d583bb4288c0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:50:24.655804 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-314178fd-753a-4ff0-8454-27ca784ac469 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/46299ff5-499b-4ec8-b2d5-f876e3303a07" status: 200 len: 1331 microversion: 2.1 time: 0.096541 Jun 07 14:50:24.656494 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 537/1083] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:50:24 2022] GET /compute/v2.1/servers/46299ff5-499b-4ec8-b2d5-f876e3303a07 => generated 1331 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:50:25.674307 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-88e75aa0-f961-4d66-a0a1-1719dbb29c83 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:50:25.675010 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-88e75aa0-f961-4d66-a0a1-1719dbb29c83 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 46299ff5-499b-4ec8-b2d5-f876e3303a07] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:50:25.681459 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-88e75aa0-f961-4d66-a0a1-1719dbb29c83 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:50:25.681908 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-88e75aa0-f961-4d66-a0a1-1719dbb29c83 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:50:25.682677 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-88e75aa0-f961-4d66-a0a1-1719dbb29c83 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:50:25.683110 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-88e75aa0-f961-4d66-a0a1-1719dbb29c83 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:50:25.716471 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-88e75aa0-f961-4d66-a0a1-1719dbb29c83 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:50:25.716839 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-88e75aa0-f961-4d66-a0a1-1719dbb29c83 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:50:25.717286 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.objects.instance [None req-88e75aa0-f961-4d66-a0a1-1719dbb29c83 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lazy-loading 'fault' on Instance uuid 46299ff5-499b-4ec8-b2d5-f876e3303a07 {{(pid=118158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 14:50:25.759792 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-88e75aa0-f961-4d66-a0a1-1719dbb29c83 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34eb9ec1f3ff44bbb03cf934cb2a04de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eae64ee53144e4f8d583bb4288c0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:50:25.767908 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-88e75aa0-f961-4d66-a0a1-1719dbb29c83 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/46299ff5-499b-4ec8-b2d5-f876e3303a07" status: 200 len: 1331 microversion: 2.1 time: 0.098333 Jun 07 14:50:25.768491 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 547/1084] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:50:25 2022] GET /compute/v2.1/servers/46299ff5-499b-4ec8-b2d5-f876e3303a07 => generated 1331 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:50:26.785660 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-e27a3850-a416-4cf3-9438-8e21ec28144b tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:50:26.786300 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-e27a3850-a416-4cf3-9438-8e21ec28144b tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 46299ff5-499b-4ec8-b2d5-f876e3303a07] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:50:26.788885 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG dbcounter [-] [118157] Writing DB stats nova_api:SELECT=64 {{(pid=118157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:50:26.793634 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-e27a3850-a416-4cf3-9438-8e21ec28144b tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:50:26.794154 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-e27a3850-a416-4cf3-9438-8e21ec28144b tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:50:26.794934 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-e27a3850-a416-4cf3-9438-8e21ec28144b tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:50:26.795377 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-e27a3850-a416-4cf3-9438-8e21ec28144b tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:50:26.809007 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.wsgi [None req-e27a3850-a416-4cf3-9438-8e21ec28144b tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] HTTP exception thrown: Instance 46299ff5-499b-4ec8-b2d5-f876e3303a07 could not be found. Jun 07 14:50:26.810714 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-e27a3850-a416-4cf3-9438-8e21ec28144b tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Request method failure captured: Jun 07 14:50:26.810714 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: request: GET /compute/v2.1/servers/46299ff5-499b-4ec8-b2d5-f876e3303a07 HTTP/1.1 Jun 07 14:50:26.810714 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Accept: application/json Jun 07 14:50:26.810714 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Accept-Encoding: identity Jun 07 14:50:26.810714 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Connection: close Jun 07 14:50:26.810714 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Content-Length: 0 Jun 07 14:50:26.810714 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Content-Type: application/json Jun 07 14:50:26.810714 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Host: 10.222.0.85 Jun 07 14:50:26.810714 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Openstack-System-Scope: None Jun 07 14:50:26.810714 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: User-Agent: python-urllib3/1.26.9 Jun 07 14:50:26.810714 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Auth-Token: gAAAAABin2MfTRQCz8-nJ9l6FZbbvZHr4ehXByNi3Z0iSJmei7E9Un8HbsXaII7Zrv5LEnKmQb4d93wyNQqjAkp1IKVfs3yISIEXnMvfKr46BwDX3CxPmlHLkbdOk4RqVmIQcl_yARDnVkQjkCk9boV0Z6LD9SMz4Q7cu_osT-ds_ddwKKWxW2w Jun 07 14:50:26.810714 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Domain-Id: None Jun 07 14:50:26.810714 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Domain-Name: None Jun 07 14:50:26.810714 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Identity-Status: Confirmed Jun 07 14:50:26.810714 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Is-Admin-Project: True Jun 07 14:50:26.810714 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Project-Domain-Id: default Jun 07 14:50:26.810714 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Project-Domain-Name: Default Jun 07 14:50:26.810714 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Project-Id: 8eae64ee53144e4f8d583bb4288c0aeb Jun 07 14:50:26.810714 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Project-Name: tempest-AttachVolumeNegativeTest-1508033184 Jun 07 14:50:26.810714 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Role: member,reader Jun 07 14:50:26.810714 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Roles: member,reader Jun 07 14:50:26.812180 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8eae64ee53144e4f8d583bb4288c0aeb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_8eae64ee53144e4f8d583bb4288c0aeb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8eae64ee53144e4f8d583bb4288c0aeb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/8eae64ee53144e4f8d583bb4288c0aeb"}]}] Jun 07 14:50:26.812180 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Tenant: tempest-AttachVolumeNegativeTest-1508033184 Jun 07 14:50:26.812180 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Tenant-Id: 8eae64ee53144e4f8d583bb4288c0aeb Jun 07 14:50:26.812180 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1508033184 Jun 07 14:50:26.812180 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User: tempest-AttachVolumeNegativeTest-1508033184-project Jun 07 14:50:26.812180 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User-Domain-Id: default Jun 07 14:50:26.812180 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User-Domain-Name: Default Jun 07 14:50:26.812180 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User-Id: 34eb9ec1f3ff44bbb03cf934cb2a04de Jun 07 14:50:26.812180 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User-Name: tempest-AttachVolumeNegativeTest-1508033184-project Jun 07 14:50:26.812180 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: method: > Jun 07 14:50:26.812180 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: exception: Instance 46299ff5-499b-4ec8-b2d5-f876e3303a07 could not be found. Jun 07 14:50:26.812180 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: action_args: {'id': '46299ff5-499b-4ec8-b2d5-f876e3303a07'} Jun 07 14:50:26.813006 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:50:26.813006 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:50:26.813006 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 14:50:26.813006 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 14:50:26.813006 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 14:50:26.813006 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 14:50:26.813006 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 14:50:26.813006 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 14:50:26.813006 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 14:50:26.813006 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 14:50:26.813006 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46299ff5-499b-4ec8-b2d5-f876e3303a07 could not be found. Jun 07 14:50:26.813006 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:50:26.813006 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:50:26.813006 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:50:26.813006 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:50:26.813006 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:50:26.813006 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:50:26.813006 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:50:26.813006 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:50:26.813006 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:50:26.814361 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:50:26.814361 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 14:50:26.814361 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 14:50:26.814361 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 14:50:26.814361 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 14:50:26.814361 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 14:50:26.814361 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:50:26.814361 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46299ff5-499b-4ec8-b2d5-f876e3303a07 could not be found. Jun 07 14:50:26.814361 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:50:26.814361 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:50:26.814361 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:50:26.814361 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:50:26.814361 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:50:26.814361 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:50:26.814361 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:50:26.814361 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:50:26.814361 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46299ff5-499b-4ec8-b2d5-f876e3303a07 could not be found. Jun 07 14:50:26.814361 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:50:26.815492 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-e27a3850-a416-4cf3-9438-8e21ec28144b tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Returning 404 to user: Instance 46299ff5-499b-4ec8-b2d5-f876e3303a07 could not be found. {{(pid=118157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:50:26.815492 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-e27a3850-a416-4cf3-9438-8e21ec28144b tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/46299ff5-499b-4ec8-b2d5-f876e3303a07" status: 404 len: 111 microversion: 2.1 time: 0.030383 Jun 07 14:50:26.815492 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 538/1085] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:50:26 2022] GET /compute/v2.1/servers/46299ff5-499b-4ec8-b2d5-f876e3303a07 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 14:50:26.820995 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-24413fad-8e9a-4c78-938a-75e76da98a27 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '.version_select at 0x7f5f827d68b0>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:50:26.824333 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR oslo.messaging._drivers.impl_rabbit [None req-24413fad-8e9a-4c78-938a-75e76da98a27 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [3e6145c6-9f0c-46c6-ad76-75c847939a0e] AMQP server on 10.222.0.85:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 07 14:50:27.832772 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO oslo.messaging._drivers.impl_rabbit [None req-24413fad-8e9a-4c78-938a-75e76da98a27 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [3e6145c6-9f0c-46c6-ad76-75c847939a0e] Reconnected to AMQP server on 10.222.0.85:5672 via [amqp] client with port 34218. Jun 07 14:50:27.992259 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-24413fad-8e9a-4c78-938a-75e76da98a27 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1257354596" status: 202 len: 0 microversion: 2.1 time: 1.174936 Jun 07 14:50:27.993233 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 548/1086] 10.222.0.85 () {58 vars in 1220 bytes} [Tue Jun 7 14:50:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1257354596 => generated 0 bytes in 1176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 14:50:34.244146 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-f034846d-d40a-4d41-9597-981aba489b1c tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:50:34.244818 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-f034846d-d40a-4d41-9597-981aba489b1c tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 46299ff5-499b-4ec8-b2d5-f876e3303a07] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:50:34.251718 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-f034846d-d40a-4d41-9597-981aba489b1c tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:50:34.254161 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-f034846d-d40a-4d41-9597-981aba489b1c tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:50:34.254161 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-f034846d-d40a-4d41-9597-981aba489b1c tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:50:34.254161 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-f034846d-d40a-4d41-9597-981aba489b1c tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:50:34.267882 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.wsgi [None req-f034846d-d40a-4d41-9597-981aba489b1c tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] HTTP exception thrown: Instance 46299ff5-499b-4ec8-b2d5-f876e3303a07 could not be found. Jun 07 14:50:34.269539 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-f034846d-d40a-4d41-9597-981aba489b1c tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Request method failure captured: Jun 07 14:50:34.269539 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: request: DELETE /compute/v2.1/servers/46299ff5-499b-4ec8-b2d5-f876e3303a07 HTTP/1.1 Jun 07 14:50:34.269539 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Accept: application/json Jun 07 14:50:34.269539 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Accept-Encoding: identity Jun 07 14:50:34.269539 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Connection: close Jun 07 14:50:34.269539 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Content-Length: 0 Jun 07 14:50:34.269539 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Content-Type: application/json Jun 07 14:50:34.269539 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Host: 10.222.0.85 Jun 07 14:50:34.269539 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Openstack-System-Scope: None Jun 07 14:50:34.269539 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: User-Agent: python-urllib3/1.26.9 Jun 07 14:50:34.269539 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Auth-Token: gAAAAABin2MfTRQCz8-nJ9l6FZbbvZHr4ehXByNi3Z0iSJmei7E9Un8HbsXaII7Zrv5LEnKmQb4d93wyNQqjAkp1IKVfs3yISIEXnMvfKr46BwDX3CxPmlHLkbdOk4RqVmIQcl_yARDnVkQjkCk9boV0Z6LD9SMz4Q7cu_osT-ds_ddwKKWxW2w Jun 07 14:50:34.269539 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Domain-Id: None Jun 07 14:50:34.269539 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Domain-Name: None Jun 07 14:50:34.269539 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Identity-Status: Confirmed Jun 07 14:50:34.269539 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Is-Admin-Project: True Jun 07 14:50:34.269539 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Project-Domain-Id: default Jun 07 14:50:34.269539 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Project-Domain-Name: Default Jun 07 14:50:34.269539 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Project-Id: 8eae64ee53144e4f8d583bb4288c0aeb Jun 07 14:50:34.269539 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Project-Name: tempest-AttachVolumeNegativeTest-1508033184 Jun 07 14:50:34.269539 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Role: member,reader Jun 07 14:50:34.269539 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Roles: member,reader Jun 07 14:50:34.271052 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8eae64ee53144e4f8d583bb4288c0aeb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_8eae64ee53144e4f8d583bb4288c0aeb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8eae64ee53144e4f8d583bb4288c0aeb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/8eae64ee53144e4f8d583bb4288c0aeb"}]}] Jun 07 14:50:34.271052 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Tenant: tempest-AttachVolumeNegativeTest-1508033184 Jun 07 14:50:34.271052 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Tenant-Id: 8eae64ee53144e4f8d583bb4288c0aeb Jun 07 14:50:34.271052 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1508033184 Jun 07 14:50:34.271052 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User: tempest-AttachVolumeNegativeTest-1508033184-project Jun 07 14:50:34.271052 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User-Domain-Id: default Jun 07 14:50:34.271052 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User-Domain-Name: Default Jun 07 14:50:34.271052 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User-Id: 34eb9ec1f3ff44bbb03cf934cb2a04de Jun 07 14:50:34.271052 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User-Name: tempest-AttachVolumeNegativeTest-1508033184-project Jun 07 14:50:34.271052 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: method: > Jun 07 14:50:34.271052 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: exception: Instance 46299ff5-499b-4ec8-b2d5-f876e3303a07 could not be found. Jun 07 14:50:34.271052 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: action_args: {'id': '46299ff5-499b-4ec8-b2d5-f876e3303a07'} Jun 07 14:50:34.271838 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:50:34.271838 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:50:34.271838 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 14:50:34.271838 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 14:50:34.271838 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 14:50:34.271838 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 14:50:34.271838 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 14:50:34.271838 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 14:50:34.271838 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 14:50:34.271838 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 14:50:34.271838 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46299ff5-499b-4ec8-b2d5-f876e3303a07 could not be found. Jun 07 14:50:34.271838 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:50:34.271838 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:50:34.271838 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:50:34.271838 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:50:34.271838 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:50:34.271838 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:50:34.271838 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:50:34.271838 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:50:34.271838 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:50:34.273207 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:50:34.273207 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 07 14:50:34.273207 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 07 14:50:34.273207 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 07 14:50:34.273207 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 07 14:50:34.273207 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 14:50:34.273207 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 14:50:34.273207 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 14:50:34.273207 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:50:34.273207 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46299ff5-499b-4ec8-b2d5-f876e3303a07 could not be found. Jun 07 14:50:34.273207 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:50:34.273207 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:50:34.273207 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:50:34.273207 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:50:34.273207 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:50:34.273207 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:50:34.273207 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:50:34.273207 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:50:34.273207 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46299ff5-499b-4ec8-b2d5-f876e3303a07 could not be found. Jun 07 14:50:34.273207 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:50:34.274636 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-f034846d-d40a-4d41-9597-981aba489b1c tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Returning 404 to user: Instance 46299ff5-499b-4ec8-b2d5-f876e3303a07 could not be found. {{(pid=118157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:50:34.274636 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-f034846d-d40a-4d41-9597-981aba489b1c tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "DELETE /compute/v2.1/servers/46299ff5-499b-4ec8-b2d5-f876e3303a07" status: 404 len: 111 microversion: 2.1 time: 0.030634 Jun 07 14:50:34.274636 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 539/1087] 10.222.0.85 () {58 vars in 1238 bytes} [Tue Jun 7 14:50:34 2022] DELETE /compute/v2.1/servers/46299ff5-499b-4ec8-b2d5-f876e3303a07 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 14:50:34.279841 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-6f21d9fc-9e71-4768-b74a-540984f9cf16 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:50:34.280495 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-6f21d9fc-9e71-4768-b74a-540984f9cf16 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 46299ff5-499b-4ec8-b2d5-f876e3303a07] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:50:34.283025 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG dbcounter [-] [118158] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:50:34.288468 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-6f21d9fc-9e71-4768-b74a-540984f9cf16 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:50:34.288925 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-6f21d9fc-9e71-4768-b74a-540984f9cf16 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:50:34.289698 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-6f21d9fc-9e71-4768-b74a-540984f9cf16 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:50:34.290167 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-6f21d9fc-9e71-4768-b74a-540984f9cf16 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:50:34.304140 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.wsgi [None req-6f21d9fc-9e71-4768-b74a-540984f9cf16 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] HTTP exception thrown: Instance 46299ff5-499b-4ec8-b2d5-f876e3303a07 could not be found. Jun 07 14:50:34.305821 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-6f21d9fc-9e71-4768-b74a-540984f9cf16 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Request method failure captured: Jun 07 14:50:34.305821 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: request: GET /compute/v2.1/servers/46299ff5-499b-4ec8-b2d5-f876e3303a07 HTTP/1.1 Jun 07 14:50:34.305821 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Accept: application/json Jun 07 14:50:34.305821 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Accept-Encoding: identity Jun 07 14:50:34.305821 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Connection: close Jun 07 14:50:34.305821 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Content-Length: 0 Jun 07 14:50:34.305821 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Content-Type: application/json Jun 07 14:50:34.305821 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Host: 10.222.0.85 Jun 07 14:50:34.305821 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Openstack-System-Scope: None Jun 07 14:50:34.305821 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: User-Agent: python-urllib3/1.26.9 Jun 07 14:50:34.305821 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Auth-Token: gAAAAABin2MfTRQCz8-nJ9l6FZbbvZHr4ehXByNi3Z0iSJmei7E9Un8HbsXaII7Zrv5LEnKmQb4d93wyNQqjAkp1IKVfs3yISIEXnMvfKr46BwDX3CxPmlHLkbdOk4RqVmIQcl_yARDnVkQjkCk9boV0Z6LD9SMz4Q7cu_osT-ds_ddwKKWxW2w Jun 07 14:50:34.305821 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Domain-Id: None Jun 07 14:50:34.305821 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Domain-Name: None Jun 07 14:50:34.305821 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Identity-Status: Confirmed Jun 07 14:50:34.305821 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Is-Admin-Project: True Jun 07 14:50:34.305821 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Domain-Id: default Jun 07 14:50:34.305821 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Domain-Name: Default Jun 07 14:50:34.305821 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Id: 8eae64ee53144e4f8d583bb4288c0aeb Jun 07 14:50:34.305821 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Name: tempest-AttachVolumeNegativeTest-1508033184 Jun 07 14:50:34.305821 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Role: member,reader Jun 07 14:50:34.305821 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Roles: member,reader Jun 07 14:50:34.307408 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8eae64ee53144e4f8d583bb4288c0aeb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_8eae64ee53144e4f8d583bb4288c0aeb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8eae64ee53144e4f8d583bb4288c0aeb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/8eae64ee53144e4f8d583bb4288c0aeb"}]}] Jun 07 14:50:34.307408 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Tenant: tempest-AttachVolumeNegativeTest-1508033184 Jun 07 14:50:34.307408 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Tenant-Id: 8eae64ee53144e4f8d583bb4288c0aeb Jun 07 14:50:34.307408 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1508033184 Jun 07 14:50:34.307408 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User: tempest-AttachVolumeNegativeTest-1508033184-project Jun 07 14:50:34.307408 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Domain-Id: default Jun 07 14:50:34.307408 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Domain-Name: Default Jun 07 14:50:34.307408 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Id: 34eb9ec1f3ff44bbb03cf934cb2a04de Jun 07 14:50:34.307408 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Name: tempest-AttachVolumeNegativeTest-1508033184-project Jun 07 14:50:34.307408 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: method: > Jun 07 14:50:34.307408 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: exception: Instance 46299ff5-499b-4ec8-b2d5-f876e3303a07 could not be found. Jun 07 14:50:34.307408 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: action_args: {'id': '46299ff5-499b-4ec8-b2d5-f876e3303a07'} Jun 07 14:50:34.308437 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:50:34.308437 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:50:34.308437 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 14:50:34.308437 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 14:50:34.308437 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 14:50:34.308437 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 14:50:34.308437 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 14:50:34.308437 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 14:50:34.308437 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 14:50:34.308437 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 14:50:34.308437 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46299ff5-499b-4ec8-b2d5-f876e3303a07 could not be found. Jun 07 14:50:34.308437 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:50:34.308437 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:50:34.308437 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:50:34.308437 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:50:34.308437 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:50:34.308437 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:50:34.308437 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:50:34.308437 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:50:34.308437 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:50:34.309894 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:50:34.309894 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 14:50:34.309894 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 14:50:34.309894 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 14:50:34.309894 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 14:50:34.309894 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 14:50:34.309894 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:50:34.309894 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46299ff5-499b-4ec8-b2d5-f876e3303a07 could not be found. Jun 07 14:50:34.309894 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:50:34.309894 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:50:34.309894 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:50:34.309894 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:50:34.309894 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:50:34.309894 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:50:34.309894 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:50:34.309894 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:50:34.309894 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46299ff5-499b-4ec8-b2d5-f876e3303a07 could not be found. Jun 07 14:50:34.309894 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:50:34.311161 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-6f21d9fc-9e71-4768-b74a-540984f9cf16 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Returning 404 to user: Instance 46299ff5-499b-4ec8-b2d5-f876e3303a07 could not be found. {{(pid=118158) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:50:34.311161 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-6f21d9fc-9e71-4768-b74a-540984f9cf16 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/46299ff5-499b-4ec8-b2d5-f876e3303a07" status: 404 len: 111 microversion: 2.1 time: 0.031549 Jun 07 14:50:34.311161 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 549/1088] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:50:34 2022] GET /compute/v2.1/servers/46299ff5-499b-4ec8-b2d5-f876e3303a07 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 14:50:35.581737 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-5ebe3381-74bb-4a4a-989f-1b3611e13b6b tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:50:35.582311 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-5ebe3381-74bb-4a4a-989f-1b3611e13b6b tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 3636f852-d3ce-4505-b21b-3bbfac40d180] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:50:35.589472 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-5ebe3381-74bb-4a4a-989f-1b3611e13b6b tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:50:35.589969 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-5ebe3381-74bb-4a4a-989f-1b3611e13b6b tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:50:35.590757 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-5ebe3381-74bb-4a4a-989f-1b3611e13b6b tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:50:35.591195 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-5ebe3381-74bb-4a4a-989f-1b3611e13b6b tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:50:35.605112 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.wsgi [None req-5ebe3381-74bb-4a4a-989f-1b3611e13b6b tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] HTTP exception thrown: Instance 3636f852-d3ce-4505-b21b-3bbfac40d180 could not be found. Jun 07 14:50:35.606711 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-5ebe3381-74bb-4a4a-989f-1b3611e13b6b tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Request method failure captured: Jun 07 14:50:35.606711 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: request: DELETE /compute/v2.1/servers/3636f852-d3ce-4505-b21b-3bbfac40d180 HTTP/1.1 Jun 07 14:50:35.606711 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Accept: application/json Jun 07 14:50:35.606711 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Accept-Encoding: identity Jun 07 14:50:35.606711 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Connection: close Jun 07 14:50:35.606711 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Content-Length: 0 Jun 07 14:50:35.606711 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Content-Type: application/json Jun 07 14:50:35.606711 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Host: 10.222.0.85 Jun 07 14:50:35.606711 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Openstack-System-Scope: None Jun 07 14:50:35.606711 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: User-Agent: python-urllib3/1.26.9 Jun 07 14:50:35.606711 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Auth-Token: gAAAAABin2MfTRQCz8-nJ9l6FZbbvZHr4ehXByNi3Z0iSJmei7E9Un8HbsXaII7Zrv5LEnKmQb4d93wyNQqjAkp1IKVfs3yISIEXnMvfKr46BwDX3CxPmlHLkbdOk4RqVmIQcl_yARDnVkQjkCk9boV0Z6LD9SMz4Q7cu_osT-ds_ddwKKWxW2w Jun 07 14:50:35.606711 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Domain-Id: None Jun 07 14:50:35.606711 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Domain-Name: None Jun 07 14:50:35.606711 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Identity-Status: Confirmed Jun 07 14:50:35.606711 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Is-Admin-Project: True Jun 07 14:50:35.606711 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Project-Domain-Id: default Jun 07 14:50:35.606711 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Project-Domain-Name: Default Jun 07 14:50:35.606711 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Project-Id: 8eae64ee53144e4f8d583bb4288c0aeb Jun 07 14:50:35.606711 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Project-Name: tempest-AttachVolumeNegativeTest-1508033184 Jun 07 14:50:35.606711 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Role: member,reader Jun 07 14:50:35.606711 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Roles: member,reader Jun 07 14:50:35.608319 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8eae64ee53144e4f8d583bb4288c0aeb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_8eae64ee53144e4f8d583bb4288c0aeb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8eae64ee53144e4f8d583bb4288c0aeb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/8eae64ee53144e4f8d583bb4288c0aeb"}]}] Jun 07 14:50:35.608319 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Tenant: tempest-AttachVolumeNegativeTest-1508033184 Jun 07 14:50:35.608319 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Tenant-Id: 8eae64ee53144e4f8d583bb4288c0aeb Jun 07 14:50:35.608319 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1508033184 Jun 07 14:50:35.608319 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User: tempest-AttachVolumeNegativeTest-1508033184-project Jun 07 14:50:35.608319 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User-Domain-Id: default Jun 07 14:50:35.608319 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User-Domain-Name: Default Jun 07 14:50:35.608319 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User-Id: 34eb9ec1f3ff44bbb03cf934cb2a04de Jun 07 14:50:35.608319 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User-Name: tempest-AttachVolumeNegativeTest-1508033184-project Jun 07 14:50:35.608319 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: method: > Jun 07 14:50:35.608319 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: exception: Instance 3636f852-d3ce-4505-b21b-3bbfac40d180 could not be found. Jun 07 14:50:35.608319 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: action_args: {'id': '3636f852-d3ce-4505-b21b-3bbfac40d180'} Jun 07 14:50:35.609238 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:50:35.609238 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:50:35.609238 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 14:50:35.609238 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 14:50:35.609238 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 14:50:35.609238 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 14:50:35.609238 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 14:50:35.609238 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 14:50:35.609238 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 14:50:35.609238 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 14:50:35.609238 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3636f852-d3ce-4505-b21b-3bbfac40d180 could not be found. Jun 07 14:50:35.609238 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:50:35.609238 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:50:35.609238 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:50:35.609238 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:50:35.609238 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:50:35.609238 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:50:35.609238 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:50:35.609238 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:50:35.609238 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:50:35.610724 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:50:35.610724 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 07 14:50:35.610724 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 07 14:50:35.610724 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 07 14:50:35.610724 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 07 14:50:35.610724 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 14:50:35.610724 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 14:50:35.610724 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 14:50:35.610724 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:50:35.610724 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3636f852-d3ce-4505-b21b-3bbfac40d180 could not be found. Jun 07 14:50:35.610724 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:50:35.610724 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:50:35.610724 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:50:35.610724 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:50:35.610724 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:50:35.610724 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:50:35.610724 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:50:35.610724 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:50:35.610724 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3636f852-d3ce-4505-b21b-3bbfac40d180 could not be found. Jun 07 14:50:35.610724 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:50:35.612257 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-5ebe3381-74bb-4a4a-989f-1b3611e13b6b tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Returning 404 to user: Instance 3636f852-d3ce-4505-b21b-3bbfac40d180 could not be found. {{(pid=118157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:50:35.612257 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-5ebe3381-74bb-4a4a-989f-1b3611e13b6b tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "DELETE /compute/v2.1/servers/3636f852-d3ce-4505-b21b-3bbfac40d180" status: 404 len: 111 microversion: 2.1 time: 0.030337 Jun 07 14:50:35.612257 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 540/1089] 10.222.0.85 () {58 vars in 1238 bytes} [Tue Jun 7 14:50:35 2022] DELETE /compute/v2.1/servers/3636f852-d3ce-4505-b21b-3bbfac40d180 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 14:50:35.617548 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-491abbba-ca98-4a99-afa4-a1a5d4330ba2 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:50:35.618293 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-491abbba-ca98-4a99-afa4-a1a5d4330ba2 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 3636f852-d3ce-4505-b21b-3bbfac40d180] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:50:35.624912 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-491abbba-ca98-4a99-afa4-a1a5d4330ba2 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:50:35.625354 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-491abbba-ca98-4a99-afa4-a1a5d4330ba2 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:50:35.626113 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-491abbba-ca98-4a99-afa4-a1a5d4330ba2 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:50:35.626545 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-491abbba-ca98-4a99-afa4-a1a5d4330ba2 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:50:35.631135 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG dbcounter [-] [118158] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:50:35.640200 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.wsgi [None req-491abbba-ca98-4a99-afa4-a1a5d4330ba2 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] HTTP exception thrown: Instance 3636f852-d3ce-4505-b21b-3bbfac40d180 could not be found. Jun 07 14:50:35.641711 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-491abbba-ca98-4a99-afa4-a1a5d4330ba2 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Request method failure captured: Jun 07 14:50:35.641711 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: request: GET /compute/v2.1/servers/3636f852-d3ce-4505-b21b-3bbfac40d180 HTTP/1.1 Jun 07 14:50:35.641711 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Accept: application/json Jun 07 14:50:35.641711 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Accept-Encoding: identity Jun 07 14:50:35.641711 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Connection: close Jun 07 14:50:35.641711 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Content-Length: 0 Jun 07 14:50:35.641711 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Content-Type: application/json Jun 07 14:50:35.641711 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Host: 10.222.0.85 Jun 07 14:50:35.641711 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Openstack-System-Scope: None Jun 07 14:50:35.641711 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: User-Agent: python-urllib3/1.26.9 Jun 07 14:50:35.641711 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Auth-Token: gAAAAABin2MfTRQCz8-nJ9l6FZbbvZHr4ehXByNi3Z0iSJmei7E9Un8HbsXaII7Zrv5LEnKmQb4d93wyNQqjAkp1IKVfs3yISIEXnMvfKr46BwDX3CxPmlHLkbdOk4RqVmIQcl_yARDnVkQjkCk9boV0Z6LD9SMz4Q7cu_osT-ds_ddwKKWxW2w Jun 07 14:50:35.641711 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Domain-Id: None Jun 07 14:50:35.641711 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Domain-Name: None Jun 07 14:50:35.641711 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Identity-Status: Confirmed Jun 07 14:50:35.641711 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Is-Admin-Project: True Jun 07 14:50:35.641711 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Domain-Id: default Jun 07 14:50:35.641711 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Domain-Name: Default Jun 07 14:50:35.641711 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Id: 8eae64ee53144e4f8d583bb4288c0aeb Jun 07 14:50:35.641711 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Name: tempest-AttachVolumeNegativeTest-1508033184 Jun 07 14:50:35.641711 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Role: member,reader Jun 07 14:50:35.641711 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Roles: member,reader Jun 07 14:50:35.643324 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8eae64ee53144e4f8d583bb4288c0aeb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_8eae64ee53144e4f8d583bb4288c0aeb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8eae64ee53144e4f8d583bb4288c0aeb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/8eae64ee53144e4f8d583bb4288c0aeb"}]}] Jun 07 14:50:35.643324 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Tenant: tempest-AttachVolumeNegativeTest-1508033184 Jun 07 14:50:35.643324 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Tenant-Id: 8eae64ee53144e4f8d583bb4288c0aeb Jun 07 14:50:35.643324 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1508033184 Jun 07 14:50:35.643324 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User: tempest-AttachVolumeNegativeTest-1508033184-project Jun 07 14:50:35.643324 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Domain-Id: default Jun 07 14:50:35.643324 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Domain-Name: Default Jun 07 14:50:35.643324 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Id: 34eb9ec1f3ff44bbb03cf934cb2a04de Jun 07 14:50:35.643324 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Name: tempest-AttachVolumeNegativeTest-1508033184-project Jun 07 14:50:35.643324 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: method: > Jun 07 14:50:35.643324 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: exception: Instance 3636f852-d3ce-4505-b21b-3bbfac40d180 could not be found. Jun 07 14:50:35.643324 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: action_args: {'id': '3636f852-d3ce-4505-b21b-3bbfac40d180'} Jun 07 14:50:35.644249 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:50:35.644249 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:50:35.644249 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 14:50:35.644249 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 14:50:35.644249 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 14:50:35.644249 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 14:50:35.644249 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 14:50:35.644249 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 14:50:35.644249 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 14:50:35.644249 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 14:50:35.644249 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3636f852-d3ce-4505-b21b-3bbfac40d180 could not be found. Jun 07 14:50:35.644249 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:50:35.644249 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:50:35.644249 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:50:35.644249 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:50:35.644249 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:50:35.644249 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:50:35.644249 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:50:35.644249 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:50:35.644249 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:50:35.645744 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:50:35.645744 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 14:50:35.645744 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 14:50:35.645744 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 14:50:35.645744 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 14:50:35.645744 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 14:50:35.645744 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:50:35.645744 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3636f852-d3ce-4505-b21b-3bbfac40d180 could not be found. Jun 07 14:50:35.645744 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:50:35.645744 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:50:35.645744 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:50:35.645744 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:50:35.645744 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:50:35.645744 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:50:35.645744 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:50:35.645744 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:50:35.645744 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3636f852-d3ce-4505-b21b-3bbfac40d180 could not be found. Jun 07 14:50:35.645744 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:50:35.647291 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-491abbba-ca98-4a99-afa4-a1a5d4330ba2 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Returning 404 to user: Instance 3636f852-d3ce-4505-b21b-3bbfac40d180 could not be found. {{(pid=118158) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:50:35.647291 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-491abbba-ca98-4a99-afa4-a1a5d4330ba2 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/3636f852-d3ce-4505-b21b-3bbfac40d180" status: 404 len: 111 microversion: 2.1 time: 0.030282 Jun 07 14:50:35.647291 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 550/1090] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:50:35 2022] GET /compute/v2.1/servers/3636f852-d3ce-4505-b21b-3bbfac40d180 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 14:50:35.652242 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-f4634f5a-8b7b-4538-8c07-b77a2c10acc1 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:50:35.652866 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-f4634f5a-8b7b-4538-8c07-b77a2c10acc1 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: a06b2dd5-e4da-4f12-ba52-40a6527f8d60] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:50:35.659039 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-f4634f5a-8b7b-4538-8c07-b77a2c10acc1 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:50:35.665490 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-f4634f5a-8b7b-4538-8c07-b77a2c10acc1 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:50:35.665490 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-f4634f5a-8b7b-4538-8c07-b77a2c10acc1 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:50:35.665490 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-f4634f5a-8b7b-4538-8c07-b77a2c10acc1 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:50:35.674142 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.wsgi [None req-f4634f5a-8b7b-4538-8c07-b77a2c10acc1 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] HTTP exception thrown: Instance a06b2dd5-e4da-4f12-ba52-40a6527f8d60 could not be found. Jun 07 14:50:35.675892 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-f4634f5a-8b7b-4538-8c07-b77a2c10acc1 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Request method failure captured: Jun 07 14:50:35.675892 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: request: DELETE /compute/v2.1/servers/a06b2dd5-e4da-4f12-ba52-40a6527f8d60 HTTP/1.1 Jun 07 14:50:35.675892 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Accept: application/json Jun 07 14:50:35.675892 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Accept-Encoding: identity Jun 07 14:50:35.675892 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Connection: close Jun 07 14:50:35.675892 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Content-Length: 0 Jun 07 14:50:35.675892 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Content-Type: application/json Jun 07 14:50:35.675892 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Host: 10.222.0.85 Jun 07 14:50:35.675892 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Openstack-System-Scope: None Jun 07 14:50:35.675892 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: User-Agent: python-urllib3/1.26.9 Jun 07 14:50:35.675892 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Auth-Token: gAAAAABin2MfTRQCz8-nJ9l6FZbbvZHr4ehXByNi3Z0iSJmei7E9Un8HbsXaII7Zrv5LEnKmQb4d93wyNQqjAkp1IKVfs3yISIEXnMvfKr46BwDX3CxPmlHLkbdOk4RqVmIQcl_yARDnVkQjkCk9boV0Z6LD9SMz4Q7cu_osT-ds_ddwKKWxW2w Jun 07 14:50:35.675892 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Domain-Id: None Jun 07 14:50:35.675892 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Domain-Name: None Jun 07 14:50:35.675892 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Identity-Status: Confirmed Jun 07 14:50:35.675892 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Is-Admin-Project: True Jun 07 14:50:35.675892 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Project-Domain-Id: default Jun 07 14:50:35.675892 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Project-Domain-Name: Default Jun 07 14:50:35.675892 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Project-Id: 8eae64ee53144e4f8d583bb4288c0aeb Jun 07 14:50:35.675892 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Project-Name: tempest-AttachVolumeNegativeTest-1508033184 Jun 07 14:50:35.675892 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Role: member,reader Jun 07 14:50:35.675892 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Roles: member,reader Jun 07 14:50:35.678950 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8eae64ee53144e4f8d583bb4288c0aeb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_8eae64ee53144e4f8d583bb4288c0aeb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8eae64ee53144e4f8d583bb4288c0aeb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/8eae64ee53144e4f8d583bb4288c0aeb"}]}] Jun 07 14:50:35.678950 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Tenant: tempest-AttachVolumeNegativeTest-1508033184 Jun 07 14:50:35.678950 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Tenant-Id: 8eae64ee53144e4f8d583bb4288c0aeb Jun 07 14:50:35.678950 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1508033184 Jun 07 14:50:35.678950 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User: tempest-AttachVolumeNegativeTest-1508033184-project Jun 07 14:50:35.678950 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User-Domain-Id: default Jun 07 14:50:35.678950 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User-Domain-Name: Default Jun 07 14:50:35.678950 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User-Id: 34eb9ec1f3ff44bbb03cf934cb2a04de Jun 07 14:50:35.678950 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User-Name: tempest-AttachVolumeNegativeTest-1508033184-project Jun 07 14:50:35.678950 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: method: > Jun 07 14:50:35.678950 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: exception: Instance a06b2dd5-e4da-4f12-ba52-40a6527f8d60 could not be found. Jun 07 14:50:35.678950 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: action_args: {'id': 'a06b2dd5-e4da-4f12-ba52-40a6527f8d60'} Jun 07 14:50:35.680582 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:50:35.680582 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:50:35.680582 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 14:50:35.680582 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 14:50:35.680582 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 14:50:35.680582 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 14:50:35.680582 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 14:50:35.680582 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 14:50:35.680582 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 14:50:35.680582 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 14:50:35.680582 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a06b2dd5-e4da-4f12-ba52-40a6527f8d60 could not be found. Jun 07 14:50:35.680582 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:50:35.680582 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:50:35.680582 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:50:35.680582 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:50:35.680582 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:50:35.680582 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:50:35.680582 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:50:35.680582 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:50:35.680582 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:50:35.683172 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:50:35.683172 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 07 14:50:35.683172 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 07 14:50:35.683172 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 07 14:50:35.683172 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 07 14:50:35.683172 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 14:50:35.683172 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 14:50:35.683172 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 14:50:35.683172 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:50:35.683172 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a06b2dd5-e4da-4f12-ba52-40a6527f8d60 could not be found. Jun 07 14:50:35.683172 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:50:35.683172 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:50:35.683172 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:50:35.683172 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:50:35.683172 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:50:35.683172 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:50:35.683172 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:50:35.683172 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:50:35.683172 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a06b2dd5-e4da-4f12-ba52-40a6527f8d60 could not be found. Jun 07 14:50:35.683172 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:50:35.685788 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-f4634f5a-8b7b-4538-8c07-b77a2c10acc1 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Returning 404 to user: Instance a06b2dd5-e4da-4f12-ba52-40a6527f8d60 could not be found. {{(pid=118157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:50:35.685788 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-f4634f5a-8b7b-4538-8c07-b77a2c10acc1 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "DELETE /compute/v2.1/servers/a06b2dd5-e4da-4f12-ba52-40a6527f8d60" status: 404 len: 111 microversion: 2.1 time: 0.029967 Jun 07 14:50:35.685788 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 541/1091] 10.222.0.85 () {58 vars in 1238 bytes} [Tue Jun 7 14:50:35 2022] DELETE /compute/v2.1/servers/a06b2dd5-e4da-4f12-ba52-40a6527f8d60 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 14:50:35.689506 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-321d8ed5-aa52-4ad3-bce3-89633504a573 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:50:35.690176 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-321d8ed5-aa52-4ad3-bce3-89633504a573 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: a06b2dd5-e4da-4f12-ba52-40a6527f8d60] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:50:35.700156 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-321d8ed5-aa52-4ad3-bce3-89633504a573 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:50:35.700156 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-321d8ed5-aa52-4ad3-bce3-89633504a573 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:50:35.700156 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-321d8ed5-aa52-4ad3-bce3-89633504a573 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:50:35.700156 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-321d8ed5-aa52-4ad3-bce3-89633504a573 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:50:35.715958 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.wsgi [None req-321d8ed5-aa52-4ad3-bce3-89633504a573 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] HTTP exception thrown: Instance a06b2dd5-e4da-4f12-ba52-40a6527f8d60 could not be found. Jun 07 14:50:35.717519 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-321d8ed5-aa52-4ad3-bce3-89633504a573 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Request method failure captured: Jun 07 14:50:35.717519 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: request: GET /compute/v2.1/servers/a06b2dd5-e4da-4f12-ba52-40a6527f8d60 HTTP/1.1 Jun 07 14:50:35.717519 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Accept: application/json Jun 07 14:50:35.717519 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Accept-Encoding: identity Jun 07 14:50:35.717519 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Connection: close Jun 07 14:50:35.717519 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Content-Length: 0 Jun 07 14:50:35.717519 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Content-Type: application/json Jun 07 14:50:35.717519 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Host: 10.222.0.85 Jun 07 14:50:35.717519 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Openstack-System-Scope: None Jun 07 14:50:35.717519 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: User-Agent: python-urllib3/1.26.9 Jun 07 14:50:35.717519 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Auth-Token: gAAAAABin2MfTRQCz8-nJ9l6FZbbvZHr4ehXByNi3Z0iSJmei7E9Un8HbsXaII7Zrv5LEnKmQb4d93wyNQqjAkp1IKVfs3yISIEXnMvfKr46BwDX3CxPmlHLkbdOk4RqVmIQcl_yARDnVkQjkCk9boV0Z6LD9SMz4Q7cu_osT-ds_ddwKKWxW2w Jun 07 14:50:35.717519 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Domain-Id: None Jun 07 14:50:35.717519 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Domain-Name: None Jun 07 14:50:35.717519 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Identity-Status: Confirmed Jun 07 14:50:35.717519 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Is-Admin-Project: True Jun 07 14:50:35.717519 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Domain-Id: default Jun 07 14:50:35.717519 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Domain-Name: Default Jun 07 14:50:35.717519 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Id: 8eae64ee53144e4f8d583bb4288c0aeb Jun 07 14:50:35.717519 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Name: tempest-AttachVolumeNegativeTest-1508033184 Jun 07 14:50:35.717519 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Role: member,reader Jun 07 14:50:35.717519 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Roles: member,reader Jun 07 14:50:35.719201 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8eae64ee53144e4f8d583bb4288c0aeb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_8eae64ee53144e4f8d583bb4288c0aeb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8eae64ee53144e4f8d583bb4288c0aeb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/8eae64ee53144e4f8d583bb4288c0aeb"}]}] Jun 07 14:50:35.719201 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Tenant: tempest-AttachVolumeNegativeTest-1508033184 Jun 07 14:50:35.719201 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Tenant-Id: 8eae64ee53144e4f8d583bb4288c0aeb Jun 07 14:50:35.719201 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1508033184 Jun 07 14:50:35.719201 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User: tempest-AttachVolumeNegativeTest-1508033184-project Jun 07 14:50:35.719201 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Domain-Id: default Jun 07 14:50:35.719201 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Domain-Name: Default Jun 07 14:50:35.719201 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Id: 34eb9ec1f3ff44bbb03cf934cb2a04de Jun 07 14:50:35.719201 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Name: tempest-AttachVolumeNegativeTest-1508033184-project Jun 07 14:50:35.719201 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: method: > Jun 07 14:50:35.719201 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: exception: Instance a06b2dd5-e4da-4f12-ba52-40a6527f8d60 could not be found. Jun 07 14:50:35.719201 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: action_args: {'id': 'a06b2dd5-e4da-4f12-ba52-40a6527f8d60'} Jun 07 14:50:35.719983 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:50:35.719983 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:50:35.719983 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 14:50:35.719983 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 14:50:35.719983 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 14:50:35.719983 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 14:50:35.719983 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 14:50:35.719983 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 14:50:35.719983 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 14:50:35.719983 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 14:50:35.719983 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a06b2dd5-e4da-4f12-ba52-40a6527f8d60 could not be found. Jun 07 14:50:35.719983 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:50:35.719983 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:50:35.719983 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:50:35.719983 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:50:35.719983 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:50:35.719983 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:50:35.719983 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:50:35.719983 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:50:35.719983 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:50:35.721698 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:50:35.721698 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 14:50:35.721698 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 14:50:35.721698 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 14:50:35.721698 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 14:50:35.721698 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 14:50:35.721698 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:50:35.721698 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a06b2dd5-e4da-4f12-ba52-40a6527f8d60 could not be found. Jun 07 14:50:35.721698 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:50:35.721698 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:50:35.721698 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:50:35.721698 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:50:35.721698 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:50:35.721698 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:50:35.721698 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:50:35.721698 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:50:35.721698 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a06b2dd5-e4da-4f12-ba52-40a6527f8d60 could not be found. Jun 07 14:50:35.721698 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:50:35.723368 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-321d8ed5-aa52-4ad3-bce3-89633504a573 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Returning 404 to user: Instance a06b2dd5-e4da-4f12-ba52-40a6527f8d60 could not be found. {{(pid=118158) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:50:35.723368 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-321d8ed5-aa52-4ad3-bce3-89633504a573 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/a06b2dd5-e4da-4f12-ba52-40a6527f8d60" status: 404 len: 111 microversion: 2.1 time: 0.034542 Jun 07 14:50:35.723368 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 551/1092] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:50:35 2022] GET /compute/v2.1/servers/a06b2dd5-e4da-4f12-ba52-40a6527f8d60 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 14:50:41.255842 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-fa707b42-d87b-4eb1-bd4a-db1102368dca tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:50:41.256351 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-fa707b42-d87b-4eb1-bd4a-db1102368dca tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 314a1177-9252-4a27-8c30-0b7af796d9a5] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:50:41.262697 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-fa707b42-d87b-4eb1-bd4a-db1102368dca tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:50:41.263128 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-fa707b42-d87b-4eb1-bd4a-db1102368dca tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:50:41.263894 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-fa707b42-d87b-4eb1-bd4a-db1102368dca tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:50:41.264334 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-fa707b42-d87b-4eb1-bd4a-db1102368dca tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:50:41.278183 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.wsgi [None req-fa707b42-d87b-4eb1-bd4a-db1102368dca tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] HTTP exception thrown: Instance 314a1177-9252-4a27-8c30-0b7af796d9a5 could not be found. Jun 07 14:50:41.279783 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-fa707b42-d87b-4eb1-bd4a-db1102368dca tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Request method failure captured: Jun 07 14:50:41.279783 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: request: DELETE /compute/v2.1/servers/314a1177-9252-4a27-8c30-0b7af796d9a5 HTTP/1.1 Jun 07 14:50:41.279783 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Accept: application/json Jun 07 14:50:41.279783 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Accept-Encoding: identity Jun 07 14:50:41.279783 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Connection: close Jun 07 14:50:41.279783 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Content-Length: 0 Jun 07 14:50:41.279783 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Content-Type: application/json Jun 07 14:50:41.279783 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Host: 10.222.0.85 Jun 07 14:50:41.279783 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Openstack-System-Scope: None Jun 07 14:50:41.279783 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: User-Agent: python-urllib3/1.26.9 Jun 07 14:50:41.279783 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Auth-Token: gAAAAABin2MfTRQCz8-nJ9l6FZbbvZHr4ehXByNi3Z0iSJmei7E9Un8HbsXaII7Zrv5LEnKmQb4d93wyNQqjAkp1IKVfs3yISIEXnMvfKr46BwDX3CxPmlHLkbdOk4RqVmIQcl_yARDnVkQjkCk9boV0Z6LD9SMz4Q7cu_osT-ds_ddwKKWxW2w Jun 07 14:50:41.279783 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Domain-Id: None Jun 07 14:50:41.279783 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Domain-Name: None Jun 07 14:50:41.279783 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Identity-Status: Confirmed Jun 07 14:50:41.279783 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Is-Admin-Project: True Jun 07 14:50:41.279783 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Project-Domain-Id: default Jun 07 14:50:41.279783 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Project-Domain-Name: Default Jun 07 14:50:41.279783 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Project-Id: 8eae64ee53144e4f8d583bb4288c0aeb Jun 07 14:50:41.279783 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Project-Name: tempest-AttachVolumeNegativeTest-1508033184 Jun 07 14:50:41.279783 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Role: member,reader Jun 07 14:50:41.279783 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Roles: member,reader Jun 07 14:50:41.281401 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8eae64ee53144e4f8d583bb4288c0aeb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_8eae64ee53144e4f8d583bb4288c0aeb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8eae64ee53144e4f8d583bb4288c0aeb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/8eae64ee53144e4f8d583bb4288c0aeb"}]}] Jun 07 14:50:41.281401 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Tenant: tempest-AttachVolumeNegativeTest-1508033184 Jun 07 14:50:41.281401 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Tenant-Id: 8eae64ee53144e4f8d583bb4288c0aeb Jun 07 14:50:41.281401 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1508033184 Jun 07 14:50:41.281401 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User: tempest-AttachVolumeNegativeTest-1508033184-project Jun 07 14:50:41.281401 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User-Domain-Id: default Jun 07 14:50:41.281401 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User-Domain-Name: Default Jun 07 14:50:41.281401 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User-Id: 34eb9ec1f3ff44bbb03cf934cb2a04de Jun 07 14:50:41.281401 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User-Name: tempest-AttachVolumeNegativeTest-1508033184-project Jun 07 14:50:41.281401 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: method: > Jun 07 14:50:41.281401 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: exception: Instance 314a1177-9252-4a27-8c30-0b7af796d9a5 could not be found. Jun 07 14:50:41.281401 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: action_args: {'id': '314a1177-9252-4a27-8c30-0b7af796d9a5'} Jun 07 14:50:41.282177 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:50:41.282177 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:50:41.282177 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 14:50:41.282177 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 14:50:41.282177 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 14:50:41.282177 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 14:50:41.282177 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 14:50:41.282177 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 14:50:41.282177 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 14:50:41.282177 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 14:50:41.282177 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 314a1177-9252-4a27-8c30-0b7af796d9a5 could not be found. Jun 07 14:50:41.282177 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:50:41.282177 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:50:41.282177 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:50:41.282177 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:50:41.282177 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:50:41.282177 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:50:41.282177 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:50:41.282177 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:50:41.282177 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:50:41.283402 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:50:41.283402 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 07 14:50:41.283402 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 07 14:50:41.283402 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 07 14:50:41.283402 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 07 14:50:41.283402 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 14:50:41.283402 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 14:50:41.283402 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 14:50:41.283402 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:50:41.283402 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 314a1177-9252-4a27-8c30-0b7af796d9a5 could not be found. Jun 07 14:50:41.283402 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:50:41.283402 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:50:41.283402 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:50:41.283402 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:50:41.283402 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:50:41.283402 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:50:41.283402 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:50:41.283402 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:50:41.283402 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 314a1177-9252-4a27-8c30-0b7af796d9a5 could not be found. Jun 07 14:50:41.283402 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:50:41.284904 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-fa707b42-d87b-4eb1-bd4a-db1102368dca tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Returning 404 to user: Instance 314a1177-9252-4a27-8c30-0b7af796d9a5 could not be found. {{(pid=118157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:50:41.284904 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-fa707b42-d87b-4eb1-bd4a-db1102368dca tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "DELETE /compute/v2.1/servers/314a1177-9252-4a27-8c30-0b7af796d9a5" status: 404 len: 111 microversion: 2.1 time: 0.029367 Jun 07 14:50:41.284904 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 542/1093] 10.222.0.85 () {58 vars in 1238 bytes} [Tue Jun 7 14:50:41 2022] DELETE /compute/v2.1/servers/314a1177-9252-4a27-8c30-0b7af796d9a5 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 14:50:41.291325 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-d4ea1838-be74-4568-ac5f-d527f229dec5 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:50:41.291971 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-d4ea1838-be74-4568-ac5f-d527f229dec5 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] [instance: 314a1177-9252-4a27-8c30-0b7af796d9a5] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:50:41.299361 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-d4ea1838-be74-4568-ac5f-d527f229dec5 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:50:41.299811 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-d4ea1838-be74-4568-ac5f-d527f229dec5 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:50:41.300601 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-d4ea1838-be74-4568-ac5f-d527f229dec5 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:50:41.301038 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-d4ea1838-be74-4568-ac5f-d527f229dec5 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:50:41.314877 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.wsgi [None req-d4ea1838-be74-4568-ac5f-d527f229dec5 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] HTTP exception thrown: Instance 314a1177-9252-4a27-8c30-0b7af796d9a5 could not be found. Jun 07 14:50:41.316507 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-d4ea1838-be74-4568-ac5f-d527f229dec5 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Request method failure captured: Jun 07 14:50:41.316507 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: request: GET /compute/v2.1/servers/314a1177-9252-4a27-8c30-0b7af796d9a5 HTTP/1.1 Jun 07 14:50:41.316507 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Accept: application/json Jun 07 14:50:41.316507 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Accept-Encoding: identity Jun 07 14:50:41.316507 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Connection: close Jun 07 14:50:41.316507 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Content-Length: 0 Jun 07 14:50:41.316507 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Content-Type: application/json Jun 07 14:50:41.316507 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Host: 10.222.0.85 Jun 07 14:50:41.316507 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Openstack-System-Scope: None Jun 07 14:50:41.316507 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: User-Agent: python-urllib3/1.26.9 Jun 07 14:50:41.316507 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Auth-Token: gAAAAABin2MfTRQCz8-nJ9l6FZbbvZHr4ehXByNi3Z0iSJmei7E9Un8HbsXaII7Zrv5LEnKmQb4d93wyNQqjAkp1IKVfs3yISIEXnMvfKr46BwDX3CxPmlHLkbdOk4RqVmIQcl_yARDnVkQjkCk9boV0Z6LD9SMz4Q7cu_osT-ds_ddwKKWxW2w Jun 07 14:50:41.316507 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Domain-Id: None Jun 07 14:50:41.316507 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Domain-Name: None Jun 07 14:50:41.316507 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Identity-Status: Confirmed Jun 07 14:50:41.316507 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Is-Admin-Project: True Jun 07 14:50:41.316507 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Domain-Id: default Jun 07 14:50:41.316507 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Domain-Name: Default Jun 07 14:50:41.316507 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Id: 8eae64ee53144e4f8d583bb4288c0aeb Jun 07 14:50:41.316507 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Name: tempest-AttachVolumeNegativeTest-1508033184 Jun 07 14:50:41.316507 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Role: member,reader Jun 07 14:50:41.316507 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Roles: member,reader Jun 07 14:50:41.326562 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8eae64ee53144e4f8d583bb4288c0aeb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_8eae64ee53144e4f8d583bb4288c0aeb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8eae64ee53144e4f8d583bb4288c0aeb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/8eae64ee53144e4f8d583bb4288c0aeb"}]}] Jun 07 14:50:41.326562 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Tenant: tempest-AttachVolumeNegativeTest-1508033184 Jun 07 14:50:41.326562 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Tenant-Id: 8eae64ee53144e4f8d583bb4288c0aeb Jun 07 14:50:41.326562 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1508033184 Jun 07 14:50:41.326562 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User: tempest-AttachVolumeNegativeTest-1508033184-project Jun 07 14:50:41.326562 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Domain-Id: default Jun 07 14:50:41.326562 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Domain-Name: Default Jun 07 14:50:41.326562 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Id: 34eb9ec1f3ff44bbb03cf934cb2a04de Jun 07 14:50:41.326562 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Name: tempest-AttachVolumeNegativeTest-1508033184-project Jun 07 14:50:41.326562 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: method: > Jun 07 14:50:41.326562 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: exception: Instance 314a1177-9252-4a27-8c30-0b7af796d9a5 could not be found. Jun 07 14:50:41.326562 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: action_args: {'id': '314a1177-9252-4a27-8c30-0b7af796d9a5'} Jun 07 14:50:41.327980 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:50:41.327980 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:50:41.327980 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 14:50:41.327980 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 14:50:41.327980 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 14:50:41.327980 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 14:50:41.327980 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 14:50:41.327980 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 14:50:41.327980 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 14:50:41.327980 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 14:50:41.327980 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 314a1177-9252-4a27-8c30-0b7af796d9a5 could not be found. Jun 07 14:50:41.327980 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:50:41.327980 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:50:41.327980 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:50:41.327980 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:50:41.327980 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:50:41.327980 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:50:41.327980 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:50:41.327980 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:50:41.327980 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:50:41.331726 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:50:41.331726 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 14:50:41.331726 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 14:50:41.331726 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 14:50:41.331726 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 14:50:41.331726 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 14:50:41.331726 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:50:41.331726 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 314a1177-9252-4a27-8c30-0b7af796d9a5 could not be found. Jun 07 14:50:41.331726 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:50:41.331726 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:50:41.331726 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:50:41.331726 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:50:41.331726 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:50:41.331726 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:50:41.331726 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:50:41.331726 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:50:41.331726 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 314a1177-9252-4a27-8c30-0b7af796d9a5 could not be found. Jun 07 14:50:41.331726 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:50:41.333146 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-d4ea1838-be74-4568-ac5f-d527f229dec5 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] Returning 404 to user: Instance 314a1177-9252-4a27-8c30-0b7af796d9a5 could not be found. {{(pid=118158) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:50:41.333146 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-d4ea1838-be74-4568-ac5f-d527f229dec5 tempest-AttachVolumeNegativeTest-1508033184 tempest-AttachVolumeNegativeTest-1508033184-project] 10.222.0.85 "GET /compute/v2.1/servers/314a1177-9252-4a27-8c30-0b7af796d9a5" status: 404 len: 111 microversion: 2.1 time: 0.031826 Jun 07 14:50:41.333146 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 552/1094] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:50:41 2022] GET /compute/v2.1/servers/314a1177-9252-4a27-8c30-0b7af796d9a5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 14:51:34.096469 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-97d05281-7927-41e8-859d-feb0b949448f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:51:34.100620 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-97d05281-7927-41e8-859d-feb0b949448f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: 89db7091-f026-4913-962e-ad45fd38b468] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:51:34.100797 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG dbcounter [-] [118157] Writing DB stats nova_api:SELECT=9 {{(pid=118157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:51:34.101490 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG dbcounter [-] [118157] Writing DB stats nova_cell1:SELECT=84 {{(pid=118157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:51:34.105522 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-97d05281-7927-41e8-859d-feb0b949448f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:51:34.110155 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-97d05281-7927-41e8-859d-feb0b949448f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:51:34.110155 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-97d05281-7927-41e8-859d-feb0b949448f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:51:34.110155 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-97d05281-7927-41e8-859d-feb0b949448f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:51:34.136194 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-97d05281-7927-41e8-859d-feb0b949448f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045316 Jun 07 14:51:34.136821 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 543/1095] 10.222.0.85 () {60 vars in 1342 bytes} [Tue Jun 7 14:51:34 2022] GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:51:34.201852 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-ccb305e0-fdff-4565-9d81-2f8f4f282f3a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:51:34.203040 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-ccb305e0-fdff-4565-9d81-2f8f4f282f3a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: 89db7091-f026-4913-962e-ad45fd38b468] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:51:34.209848 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-ccb305e0-fdff-4565-9d81-2f8f4f282f3a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:51:34.210308 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-ccb305e0-fdff-4565-9d81-2f8f4f282f3a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:51:34.211081 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-ccb305e0-fdff-4565-9d81-2f8f4f282f3a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:51:34.211521 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-ccb305e0-fdff-4565-9d81-2f8f4f282f3a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:51:34.237010 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-ccb305e0-fdff-4565-9d81-2f8f4f282f3a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: 89db7091-f026-4913-962e-ad45fd38b468] Going to try to terminate instance {{(pid=118158) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 14:51:34.491040 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-ccb305e0-fdff-4565-9d81-2f8f4f282f3a tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "DELETE /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468" status: 204 len: 0 microversion: 2.20 time: 0.294526 Jun 07 14:51:34.491619 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 553/1096] 10.222.0.85 () {60 vars in 1279 bytes} [Tue Jun 7 14:51:34 2022] DELETE /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 07 14:51:34.500487 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-ae48aa7c-c45a-461a-ac8a-13d1fe7bb408 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:51:34.501231 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-ae48aa7c-c45a-461a-ac8a-13d1fe7bb408 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: 89db7091-f026-4913-962e-ad45fd38b468] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:51:34.507406 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-ae48aa7c-c45a-461a-ac8a-13d1fe7bb408 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:51:34.507857 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-ae48aa7c-c45a-461a-ac8a-13d1fe7bb408 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:51:34.508661 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-ae48aa7c-c45a-461a-ac8a-13d1fe7bb408 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:51:34.509103 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-ae48aa7c-c45a-461a-ac8a-13d1fe7bb408 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:51:34.640055 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-ae48aa7c-c45a-461a-ac8a-13d1fe7bb408 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:51:34.648301 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-ae48aa7c-c45a-461a-ac8a-13d1fe7bb408 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:51:34.649918 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-ae48aa7c-c45a-461a-ac8a-13d1fe7bb408 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:51:34.651120 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-ae48aa7c-c45a-461a-ac8a-13d1fe7bb408 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468" status: 200 len: 1720 microversion: 2.20 time: 0.155110 Jun 07 14:51:34.651934 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 544/1097] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:51:34 2022] GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:51:35.670428 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-8c3e9b5d-289f-4aaa-b5a3-40ce933f33ee tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:51:35.671515 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-8c3e9b5d-289f-4aaa-b5a3-40ce933f33ee tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: 89db7091-f026-4913-962e-ad45fd38b468] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:51:35.681139 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-8c3e9b5d-289f-4aaa-b5a3-40ce933f33ee tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:51:35.682299 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-8c3e9b5d-289f-4aaa-b5a3-40ce933f33ee tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:51:35.683444 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-8c3e9b5d-289f-4aaa-b5a3-40ce933f33ee tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:51:35.684090 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-8c3e9b5d-289f-4aaa-b5a3-40ce933f33ee tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:51:35.824885 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-8c3e9b5d-289f-4aaa-b5a3-40ce933f33ee tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:51:35.833268 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-8c3e9b5d-289f-4aaa-b5a3-40ce933f33ee tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:51:35.834784 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-8c3e9b5d-289f-4aaa-b5a3-40ce933f33ee tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:51:35.835998 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-8c3e9b5d-289f-4aaa-b5a3-40ce933f33ee tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468" status: 200 len: 1720 microversion: 2.20 time: 0.170109 Jun 07 14:51:35.836574 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 554/1098] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:51:35 2022] GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468 => generated 1720 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:51:36.855492 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-3f877512-7540-4fc1-997d-a9d67360ef75 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:51:36.858590 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-3f877512-7540-4fc1-997d-a9d67360ef75 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: 89db7091-f026-4913-962e-ad45fd38b468] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:51:36.863478 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-3f877512-7540-4fc1-997d-a9d67360ef75 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:51:36.864130 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-3f877512-7540-4fc1-997d-a9d67360ef75 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:51:36.865163 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-3f877512-7540-4fc1-997d-a9d67360ef75 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:51:36.865887 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-3f877512-7540-4fc1-997d-a9d67360ef75 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:51:37.010048 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-3f877512-7540-4fc1-997d-a9d67360ef75 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:51:37.018468 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-3f877512-7540-4fc1-997d-a9d67360ef75 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:51:37.019970 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-3f877512-7540-4fc1-997d-a9d67360ef75 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:51:37.021170 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-3f877512-7540-4fc1-997d-a9d67360ef75 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468" status: 200 len: 1720 microversion: 2.20 time: 0.170138 Jun 07 14:51:37.021727 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 545/1099] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:51:36 2022] GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468 => generated 1720 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:51:38.040106 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-bcfd55a7-c5b6-4475-a14f-7bb04ea1ed15 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:51:38.040742 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-bcfd55a7-c5b6-4475-a14f-7bb04ea1ed15 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: 89db7091-f026-4913-962e-ad45fd38b468] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:51:38.048109 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-bcfd55a7-c5b6-4475-a14f-7bb04ea1ed15 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:51:38.048594 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-bcfd55a7-c5b6-4475-a14f-7bb04ea1ed15 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:51:38.049351 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-bcfd55a7-c5b6-4475-a14f-7bb04ea1ed15 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:51:38.049781 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-bcfd55a7-c5b6-4475-a14f-7bb04ea1ed15 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:51:38.180888 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-bcfd55a7-c5b6-4475-a14f-7bb04ea1ed15 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:51:38.189010 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-bcfd55a7-c5b6-4475-a14f-7bb04ea1ed15 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:51:38.190516 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-bcfd55a7-c5b6-4475-a14f-7bb04ea1ed15 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:51:38.191674 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-bcfd55a7-c5b6-4475-a14f-7bb04ea1ed15 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468" status: 200 len: 1720 microversion: 2.20 time: 0.155396 Jun 07 14:51:38.192220 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 555/1100] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:51:38 2022] GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:51:39.213710 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-38c191db-1780-4fe1-85c2-a8ac55eed46d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:51:39.214186 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-38c191db-1780-4fe1-85c2-a8ac55eed46d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: 89db7091-f026-4913-962e-ad45fd38b468] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:51:39.220050 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-38c191db-1780-4fe1-85c2-a8ac55eed46d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:51:39.220540 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-38c191db-1780-4fe1-85c2-a8ac55eed46d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:51:39.221311 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-38c191db-1780-4fe1-85c2-a8ac55eed46d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:51:39.221753 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-38c191db-1780-4fe1-85c2-a8ac55eed46d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:51:39.354699 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-38c191db-1780-4fe1-85c2-a8ac55eed46d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:51:39.362789 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-38c191db-1780-4fe1-85c2-a8ac55eed46d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:51:39.364385 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-38c191db-1780-4fe1-85c2-a8ac55eed46d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:51:39.365544 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-38c191db-1780-4fe1-85c2-a8ac55eed46d tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468" status: 200 len: 1720 microversion: 2.20 time: 0.156206 Jun 07 14:51:39.366084 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 546/1101] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:51:39 2022] GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468 => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:51:40.384650 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-841d4581-9695-401a-a008-9149453452af tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:51:40.385228 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-841d4581-9695-401a-a008-9149453452af tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: 89db7091-f026-4913-962e-ad45fd38b468] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:51:40.391855 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-841d4581-9695-401a-a008-9149453452af tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:51:40.395861 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-841d4581-9695-401a-a008-9149453452af tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:51:40.395861 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-841d4581-9695-401a-a008-9149453452af tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:51:40.395861 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-841d4581-9695-401a-a008-9149453452af tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:51:40.521947 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-841d4581-9695-401a-a008-9149453452af tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:51:40.530287 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-841d4581-9695-401a-a008-9149453452af tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:51:40.531815 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-841d4581-9695-401a-a008-9149453452af tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:51:40.533001 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-841d4581-9695-401a-a008-9149453452af tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468" status: 200 len: 1720 microversion: 2.20 time: 0.152336 Jun 07 14:51:40.533565 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 556/1102] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:51:40 2022] GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468 => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:51:41.551337 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-b1686919-ee42-4670-b13c-b827e8a3b903 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:51:41.551975 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-b1686919-ee42-4670-b13c-b827e8a3b903 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: 89db7091-f026-4913-962e-ad45fd38b468] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:51:41.558709 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-b1686919-ee42-4670-b13c-b827e8a3b903 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:51:41.559156 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-b1686919-ee42-4670-b13c-b827e8a3b903 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:51:41.559930 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-b1686919-ee42-4670-b13c-b827e8a3b903 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:51:41.560364 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-b1686919-ee42-4670-b13c-b827e8a3b903 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:51:41.626625 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-b1686919-ee42-4670-b13c-b827e8a3b903 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:51:41.634779 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-b1686919-ee42-4670-b13c-b827e8a3b903 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:51:41.636303 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-b1686919-ee42-4670-b13c-b827e8a3b903 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:51:41.637617 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-b1686919-ee42-4670-b13c-b827e8a3b903 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468" status: 200 len: 1653 microversion: 2.20 time: 0.090282 Jun 07 14:51:41.638159 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 547/1103] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:51:41 2022] GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468 => generated 1653 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 14:51:41.906256 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [req-bfcbff0d-1eae-431b-b48d-69209343527c req-e325a32b-ccf1-4958-b68d-7de3e286b00d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89db7091-f026-4913-962e-ad45fd38b468", "name": "network-vif-deleted", "tag": "cf25b5fc-6d60-40d5-8461-593838e20baf"}]} {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:51:41.914773 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [req-bfcbff0d-1eae-431b-b48d-69209343527c req-e325a32b-ccf1-4958-b68d-7de3e286b00d service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:51:41.915254 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [req-bfcbff0d-1eae-431b-b48d-69209343527c req-e325a32b-ccf1-4958-b68d-7de3e286b00d service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:51:41.926873 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.compute.server_external_events [req-bfcbff0d-1eae-431b-b48d-69209343527c req-e325a32b-ccf1-4958-b68d-7de3e286b00d service nova] Creating event network-vif-deleted:cf25b5fc-6d60-40d5-8461-593838e20baf for instance 89db7091-f026-4913-962e-ad45fd38b468 on hv-cinder-84497 Jun 07 14:51:41.932313 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [req-bfcbff0d-1eae-431b-b48d-69209343527c req-e325a32b-ccf1-4958-b68d-7de3e286b00d service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.162384 Jun 07 14:51:41.932955 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 557/1104] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jun 7 14:51:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:51:42.655716 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-a2bc9dd6-b9b5-49e6-8cb1-17e0520f1e3f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:51:42.656421 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-a2bc9dd6-b9b5-49e6-8cb1-17e0520f1e3f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: 89db7091-f026-4913-962e-ad45fd38b468] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:51:42.662987 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-a2bc9dd6-b9b5-49e6-8cb1-17e0520f1e3f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:51:42.663436 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-a2bc9dd6-b9b5-49e6-8cb1-17e0520f1e3f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:51:42.664194 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-a2bc9dd6-b9b5-49e6-8cb1-17e0520f1e3f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:51:42.664664 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-a2bc9dd6-b9b5-49e6-8cb1-17e0520f1e3f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:51:42.729666 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-a2bc9dd6-b9b5-49e6-8cb1-17e0520f1e3f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:51:42.738922 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-a2bc9dd6-b9b5-49e6-8cb1-17e0520f1e3f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:51:42.740526 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-a2bc9dd6-b9b5-49e6-8cb1-17e0520f1e3f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:51:42.741723 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-a2bc9dd6-b9b5-49e6-8cb1-17e0520f1e3f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468" status: 200 len: 1653 microversion: 2.20 time: 0.090277 Jun 07 14:51:42.747693 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 548/1105] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:51:42 2022] GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468 => generated 1653 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:51:43.762230 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-b4e5e523-bcc3-4e62-aa78-6bdb3f622ba6 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:51:43.762940 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-b4e5e523-bcc3-4e62-aa78-6bdb3f622ba6 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: 89db7091-f026-4913-962e-ad45fd38b468] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:51:43.769942 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-b4e5e523-bcc3-4e62-aa78-6bdb3f622ba6 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:51:43.770390 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-b4e5e523-bcc3-4e62-aa78-6bdb3f622ba6 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:51:43.771163 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-b4e5e523-bcc3-4e62-aa78-6bdb3f622ba6 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:51:43.771602 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-b4e5e523-bcc3-4e62-aa78-6bdb3f622ba6 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:51:44.099917 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-b4e5e523-bcc3-4e62-aa78-6bdb3f622ba6 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:51:44.108509 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-b4e5e523-bcc3-4e62-aa78-6bdb3f622ba6 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:51:44.110003 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-b4e5e523-bcc3-4e62-aa78-6bdb3f622ba6 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:51:44.111160 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-b4e5e523-bcc3-4e62-aa78-6bdb3f622ba6 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468" status: 200 len: 1653 microversion: 2.20 time: 0.353424 Jun 07 14:51:44.111709 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 558/1106] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:51:43 2022] GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468 => generated 1653 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 14:51:45.130030 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-c58b8e18-1bc5-4a6d-9fd1-60a41828c2c6 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:51:45.130596 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-c58b8e18-1bc5-4a6d-9fd1-60a41828c2c6 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: 89db7091-f026-4913-962e-ad45fd38b468] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:51:45.137782 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-c58b8e18-1bc5-4a6d-9fd1-60a41828c2c6 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:51:45.138230 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-c58b8e18-1bc5-4a6d-9fd1-60a41828c2c6 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:51:45.139001 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-c58b8e18-1bc5-4a6d-9fd1-60a41828c2c6 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:51:45.139496 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-c58b8e18-1bc5-4a6d-9fd1-60a41828c2c6 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:51:45.206223 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-c58b8e18-1bc5-4a6d-9fd1-60a41828c2c6 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:51:45.214749 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-c58b8e18-1bc5-4a6d-9fd1-60a41828c2c6 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:51:45.216440 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-c58b8e18-1bc5-4a6d-9fd1-60a41828c2c6 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed3353d3d8a242e1a6b54d31adf97a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6714e8cfaee34ac3af916af5e4bb1031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:51:45.217418 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-c58b8e18-1bc5-4a6d-9fd1-60a41828c2c6 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468" status: 200 len: 1653 microversion: 2.20 time: 0.091386 Jun 07 14:51:45.217970 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 549/1107] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:51:45 2022] GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468 => generated 1653 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 14:51:46.236497 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-66488e19-6775-4a61-bce9-8c4afa06918f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:51:46.237209 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-66488e19-6775-4a61-bce9-8c4afa06918f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: 89db7091-f026-4913-962e-ad45fd38b468] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:51:46.243791 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-66488e19-6775-4a61-bce9-8c4afa06918f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:51:46.244245 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-66488e19-6775-4a61-bce9-8c4afa06918f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:51:46.245770 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-66488e19-6775-4a61-bce9-8c4afa06918f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:51:46.246212 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-66488e19-6775-4a61-bce9-8c4afa06918f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:51:46.259656 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.wsgi [None req-66488e19-6775-4a61-bce9-8c4afa06918f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] HTTP exception thrown: Instance 89db7091-f026-4913-962e-ad45fd38b468 could not be found. Jun 07 14:51:46.261369 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-66488e19-6775-4a61-bce9-8c4afa06918f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Request method failure captured: Jun 07 14:51:46.261369 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: request: GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468 HTTP/1.1 Jun 07 14:51:46.261369 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Accept: application/json Jun 07 14:51:46.261369 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Accept-Encoding: identity Jun 07 14:51:46.261369 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Connection: close Jun 07 14:51:46.261369 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Content-Length: 0 Jun 07 14:51:46.261369 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Content-Type: application/json Jun 07 14:51:46.261369 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Host: 10.222.0.85 Jun 07 14:51:46.261369 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Openstack-System-Scope: None Jun 07 14:51:46.261369 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: User-Agent: python-urllib3/1.26.9 Jun 07 14:51:46.261369 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Auth-Token: gAAAAABin2N4eg8ljLkujTllXmla-f9Utwkro_n2NGvX66R0WQ3VhG9X255DHwF93uP2eLCGyu4YzGgS25vgqUptMxS_YvCNFIrvRsHolae3yVnlb5rJduKT46NpWaBuq7E5pf08GFOQq58grSyxOEnc51TMZmGRHSL2y5vODYb6A4UfzXPec-g Jun 07 14:51:46.261369 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Domain-Id: None Jun 07 14:51:46.261369 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Domain-Name: None Jun 07 14:51:46.261369 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Identity-Status: Confirmed Jun 07 14:51:46.261369 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Is-Admin-Project: True Jun 07 14:51:46.261369 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Openstack-Nova-Api-Version: 2.20 Jun 07 14:51:46.261369 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Domain-Id: default Jun 07 14:51:46.261369 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Domain-Name: Default Jun 07 14:51:46.261369 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Id: 6714e8cfaee34ac3af916af5e4bb1031 Jun 07 14:51:46.261369 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-550906303 Jun 07 14:51:46.261369 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Role: member,reader Jun 07 14:51:46.261369 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Roles: member,reader Jun 07 14:51:46.262874 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/6714e8cfaee34ac3af916af5e4bb1031"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_6714e8cfaee34ac3af916af5e4bb1031"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/6714e8cfaee34ac3af916af5e4bb1031"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/6714e8cfaee34ac3af916af5e4bb1031"}]}] Jun 07 14:51:46.262874 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Tenant: tempest-AttachVolumeShelveTestJSON-550906303 Jun 07 14:51:46.262874 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Tenant-Id: 6714e8cfaee34ac3af916af5e4bb1031 Jun 07 14:51:46.262874 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-550906303 Jun 07 14:51:46.262874 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User: tempest-AttachVolumeShelveTestJSON-550906303-project Jun 07 14:51:46.262874 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Domain-Id: default Jun 07 14:51:46.262874 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Domain-Name: Default Jun 07 14:51:46.262874 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Id: ed3353d3d8a242e1a6b54d31adf97a6d Jun 07 14:51:46.262874 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Name: tempest-AttachVolumeShelveTestJSON-550906303-project Jun 07 14:51:46.262874 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: method: > Jun 07 14:51:46.262874 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: exception: Instance 89db7091-f026-4913-962e-ad45fd38b468 could not be found. Jun 07 14:51:46.262874 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: action_args: {'id': '89db7091-f026-4913-962e-ad45fd38b468'} Jun 07 14:51:46.263758 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:51:46.263758 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:51:46.263758 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 14:51:46.263758 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 14:51:46.263758 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 14:51:46.263758 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 14:51:46.263758 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 14:51:46.263758 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 14:51:46.263758 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 14:51:46.263758 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 14:51:46.263758 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89db7091-f026-4913-962e-ad45fd38b468 could not be found. Jun 07 14:51:46.263758 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:51:46.263758 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:51:46.263758 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:51:46.263758 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:51:46.263758 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:51:46.263758 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:51:46.263758 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:51:46.263758 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:51:46.263758 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:51:46.265409 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:51:46.265409 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 14:51:46.265409 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 14:51:46.265409 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 14:51:46.265409 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 14:51:46.265409 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 14:51:46.265409 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:51:46.265409 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89db7091-f026-4913-962e-ad45fd38b468 could not be found. Jun 07 14:51:46.265409 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:51:46.265409 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:51:46.265409 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:51:46.265409 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:51:46.265409 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:51:46.265409 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:51:46.265409 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:51:46.265409 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:51:46.265409 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89db7091-f026-4913-962e-ad45fd38b468 could not be found. Jun 07 14:51:46.265409 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:51:46.266903 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-66488e19-6775-4a61-bce9-8c4afa06918f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Returning 404 to user: Instance 89db7091-f026-4913-962e-ad45fd38b468 could not be found. {{(pid=118158) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:51:46.266903 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-66488e19-6775-4a61-bce9-8c4afa06918f tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468" status: 404 len: 111 microversion: 2.20 time: 0.030682 Jun 07 14:51:46.266903 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 559/1108] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:51:46 2022] GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 07 14:51:46.271717 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-412018ab-ca68-4741-b73c-b21cc8c1a6f9 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '.version_select at 0x7f5f8825a310>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:51:46.355376 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-412018ab-ca68-4741-b73c-b21cc8c1a6f9 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-46072299" status: 204 len: 0 microversion: 2.20 time: 0.087406 Jun 07 14:51:46.355953 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 550/1109] 10.222.0.85 () {60 vars in 1255 bytes} [Tue Jun 7 14:51:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-46072299 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 07 14:51:52.709187 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-fb07d34b-304d-4a36-a368-12c014362869 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:51:52.709714 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-fb07d34b-304d-4a36-a368-12c014362869 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: 89db7091-f026-4913-962e-ad45fd38b468] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:51:52.715849 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-fb07d34b-304d-4a36-a368-12c014362869 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:51:52.716637 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-fb07d34b-304d-4a36-a368-12c014362869 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:51:52.717443 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-fb07d34b-304d-4a36-a368-12c014362869 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:51:52.717875 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-fb07d34b-304d-4a36-a368-12c014362869 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:51:52.734539 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.wsgi [None req-fb07d34b-304d-4a36-a368-12c014362869 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] HTTP exception thrown: Instance 89db7091-f026-4913-962e-ad45fd38b468 could not be found. Jun 07 14:51:52.736178 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-fb07d34b-304d-4a36-a368-12c014362869 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Request method failure captured: Jun 07 14:51:52.736178 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: request: DELETE /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468 HTTP/1.1 Jun 07 14:51:52.736178 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Accept: application/json Jun 07 14:51:52.736178 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Accept-Encoding: identity Jun 07 14:51:52.736178 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Connection: close Jun 07 14:51:52.736178 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Content-Length: 0 Jun 07 14:51:52.736178 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Content-Type: application/json Jun 07 14:51:52.736178 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Host: 10.222.0.85 Jun 07 14:51:52.736178 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Openstack-System-Scope: None Jun 07 14:51:52.736178 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: User-Agent: python-urllib3/1.26.9 Jun 07 14:51:52.736178 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Auth-Token: gAAAAABin2N4eg8ljLkujTllXmla-f9Utwkro_n2NGvX66R0WQ3VhG9X255DHwF93uP2eLCGyu4YzGgS25vgqUptMxS_YvCNFIrvRsHolae3yVnlb5rJduKT46NpWaBuq7E5pf08GFOQq58grSyxOEnc51TMZmGRHSL2y5vODYb6A4UfzXPec-g Jun 07 14:51:52.736178 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Domain-Id: None Jun 07 14:51:52.736178 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Domain-Name: None Jun 07 14:51:52.736178 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Identity-Status: Confirmed Jun 07 14:51:52.736178 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Is-Admin-Project: True Jun 07 14:51:52.736178 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Openstack-Nova-Api-Version: 2.20 Jun 07 14:51:52.736178 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Domain-Id: default Jun 07 14:51:52.736178 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Domain-Name: Default Jun 07 14:51:52.736178 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Id: 6714e8cfaee34ac3af916af5e4bb1031 Jun 07 14:51:52.736178 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-550906303 Jun 07 14:51:52.736178 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Role: member,reader Jun 07 14:51:52.736178 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Roles: member,reader Jun 07 14:51:52.742113 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/6714e8cfaee34ac3af916af5e4bb1031"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_6714e8cfaee34ac3af916af5e4bb1031"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/6714e8cfaee34ac3af916af5e4bb1031"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/6714e8cfaee34ac3af916af5e4bb1031"}]}] Jun 07 14:51:52.742113 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Tenant: tempest-AttachVolumeShelveTestJSON-550906303 Jun 07 14:51:52.742113 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Tenant-Id: 6714e8cfaee34ac3af916af5e4bb1031 Jun 07 14:51:52.742113 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-550906303 Jun 07 14:51:52.742113 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User: tempest-AttachVolumeShelveTestJSON-550906303-project Jun 07 14:51:52.742113 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Domain-Id: default Jun 07 14:51:52.742113 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Domain-Name: Default Jun 07 14:51:52.742113 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Id: ed3353d3d8a242e1a6b54d31adf97a6d Jun 07 14:51:52.742113 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Name: tempest-AttachVolumeShelveTestJSON-550906303-project Jun 07 14:51:52.742113 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: method: > Jun 07 14:51:52.742113 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: exception: Instance 89db7091-f026-4913-962e-ad45fd38b468 could not be found. Jun 07 14:51:52.742113 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: action_args: {'id': '89db7091-f026-4913-962e-ad45fd38b468'} Jun 07 14:51:52.743128 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:51:52.743128 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:51:52.743128 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 14:51:52.743128 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 14:51:52.743128 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 14:51:52.743128 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 14:51:52.743128 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 14:51:52.743128 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 14:51:52.743128 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 14:51:52.743128 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 14:51:52.743128 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89db7091-f026-4913-962e-ad45fd38b468 could not be found. Jun 07 14:51:52.743128 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:51:52.743128 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:51:52.743128 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:51:52.743128 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:51:52.743128 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:51:52.743128 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:51:52.743128 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:51:52.743128 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:51:52.743128 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:51:52.744363 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:51:52.744363 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 07 14:51:52.744363 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 07 14:51:52.744363 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 07 14:51:52.744363 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 07 14:51:52.744363 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 14:51:52.744363 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 14:51:52.744363 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 14:51:52.744363 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:51:52.744363 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89db7091-f026-4913-962e-ad45fd38b468 could not be found. Jun 07 14:51:52.744363 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:51:52.744363 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:51:52.744363 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:51:52.744363 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:51:52.744363 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:51:52.744363 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:51:52.744363 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:51:52.744363 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:51:52.744363 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89db7091-f026-4913-962e-ad45fd38b468 could not be found. Jun 07 14:51:52.744363 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:51:52.745610 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-fb07d34b-304d-4a36-a368-12c014362869 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Returning 404 to user: Instance 89db7091-f026-4913-962e-ad45fd38b468 could not be found. {{(pid=118158) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:51:52.745610 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-fb07d34b-304d-4a36-a368-12c014362869 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "DELETE /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468" status: 404 len: 111 microversion: 2.20 time: 0.032915 Jun 07 14:51:52.745610 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 560/1110] 10.222.0.85 () {60 vars in 1279 bytes} [Tue Jun 7 14:51:52 2022] DELETE /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 07 14:51:52.747872 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-023528e3-d925-4743-a1bc-18c4ad2820b1 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:51:52.748521 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-023528e3-d925-4743-a1bc-18c4ad2820b1 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: 89db7091-f026-4913-962e-ad45fd38b468] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:51:52.756195 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-023528e3-d925-4743-a1bc-18c4ad2820b1 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:51:52.756688 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-023528e3-d925-4743-a1bc-18c4ad2820b1 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:51:52.757458 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-023528e3-d925-4743-a1bc-18c4ad2820b1 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:51:52.757971 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-023528e3-d925-4743-a1bc-18c4ad2820b1 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:51:52.774836 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.wsgi [None req-023528e3-d925-4743-a1bc-18c4ad2820b1 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] HTTP exception thrown: Instance 89db7091-f026-4913-962e-ad45fd38b468 could not be found. Jun 07 14:51:52.776420 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-023528e3-d925-4743-a1bc-18c4ad2820b1 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Request method failure captured: Jun 07 14:51:52.776420 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: request: GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468 HTTP/1.1 Jun 07 14:51:52.776420 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Accept: application/json Jun 07 14:51:52.776420 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Accept-Encoding: identity Jun 07 14:51:52.776420 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Connection: close Jun 07 14:51:52.776420 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Content-Length: 0 Jun 07 14:51:52.776420 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Content-Type: application/json Jun 07 14:51:52.776420 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Host: 10.222.0.85 Jun 07 14:51:52.776420 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Openstack-System-Scope: None Jun 07 14:51:52.776420 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: User-Agent: python-urllib3/1.26.9 Jun 07 14:51:52.776420 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Auth-Token: gAAAAABin2N4eg8ljLkujTllXmla-f9Utwkro_n2NGvX66R0WQ3VhG9X255DHwF93uP2eLCGyu4YzGgS25vgqUptMxS_YvCNFIrvRsHolae3yVnlb5rJduKT46NpWaBuq7E5pf08GFOQq58grSyxOEnc51TMZmGRHSL2y5vODYb6A4UfzXPec-g Jun 07 14:51:52.776420 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Domain-Id: None Jun 07 14:51:52.776420 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Domain-Name: None Jun 07 14:51:52.776420 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Identity-Status: Confirmed Jun 07 14:51:52.776420 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Is-Admin-Project: True Jun 07 14:51:52.776420 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Openstack-Nova-Api-Version: 2.20 Jun 07 14:51:52.776420 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Project-Domain-Id: default Jun 07 14:51:52.776420 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Project-Domain-Name: Default Jun 07 14:51:52.776420 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Project-Id: 6714e8cfaee34ac3af916af5e4bb1031 Jun 07 14:51:52.776420 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-550906303 Jun 07 14:51:52.776420 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Role: member,reader Jun 07 14:51:52.776420 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Roles: member,reader Jun 07 14:51:52.778446 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/6714e8cfaee34ac3af916af5e4bb1031"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_6714e8cfaee34ac3af916af5e4bb1031"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/6714e8cfaee34ac3af916af5e4bb1031"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/6714e8cfaee34ac3af916af5e4bb1031"}]}] Jun 07 14:51:52.778446 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Tenant: tempest-AttachVolumeShelveTestJSON-550906303 Jun 07 14:51:52.778446 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Tenant-Id: 6714e8cfaee34ac3af916af5e4bb1031 Jun 07 14:51:52.778446 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-550906303 Jun 07 14:51:52.778446 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User: tempest-AttachVolumeShelveTestJSON-550906303-project Jun 07 14:51:52.778446 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User-Domain-Id: default Jun 07 14:51:52.778446 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User-Domain-Name: Default Jun 07 14:51:52.778446 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User-Id: ed3353d3d8a242e1a6b54d31adf97a6d Jun 07 14:51:52.778446 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User-Name: tempest-AttachVolumeShelveTestJSON-550906303-project Jun 07 14:51:52.778446 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: method: > Jun 07 14:51:52.778446 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: exception: Instance 89db7091-f026-4913-962e-ad45fd38b468 could not be found. Jun 07 14:51:52.778446 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: action_args: {'id': '89db7091-f026-4913-962e-ad45fd38b468'} Jun 07 14:51:52.779203 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:51:52.779203 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:51:52.779203 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 14:51:52.779203 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 14:51:52.779203 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 14:51:52.779203 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 14:51:52.779203 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 14:51:52.779203 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 14:51:52.779203 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 14:51:52.779203 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 14:51:52.779203 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89db7091-f026-4913-962e-ad45fd38b468 could not be found. Jun 07 14:51:52.779203 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:51:52.779203 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:51:52.779203 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:51:52.779203 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:51:52.779203 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:51:52.779203 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:51:52.779203 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:51:52.779203 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:51:52.779203 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:51:52.780501 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:51:52.780501 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 14:51:52.780501 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 14:51:52.780501 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 14:51:52.780501 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 14:51:52.780501 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 14:51:52.780501 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:51:52.780501 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89db7091-f026-4913-962e-ad45fd38b468 could not be found. Jun 07 14:51:52.780501 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:51:52.780501 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:51:52.780501 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:51:52.780501 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:51:52.780501 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:51:52.780501 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:51:52.780501 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:51:52.780501 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:51:52.780501 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89db7091-f026-4913-962e-ad45fd38b468 could not be found. Jun 07 14:51:52.780501 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:51:52.781722 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-023528e3-d925-4743-a1bc-18c4ad2820b1 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Returning 404 to user: Instance 89db7091-f026-4913-962e-ad45fd38b468 could not be found. {{(pid=118157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:51:52.781722 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-023528e3-d925-4743-a1bc-18c4ad2820b1 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468" status: 404 len: 111 microversion: 2.20 time: 0.034072 Jun 07 14:51:52.781722 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 551/1111] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:51:52 2022] GET /compute/v2.1/servers/89db7091-f026-4913-962e-ad45fd38b468 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 07 14:51:54.053740 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-0777693e-2444-44ba-a8e4-a11f6bdf8048 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:51:54.054248 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-0777693e-2444-44ba-a8e4-a11f6bdf8048 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:51:54.060793 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-0777693e-2444-44ba-a8e4-a11f6bdf8048 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:51:54.061238 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-0777693e-2444-44ba-a8e4-a11f6bdf8048 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:51:54.062656 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-0777693e-2444-44ba-a8e4-a11f6bdf8048 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:51:54.063092 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-0777693e-2444-44ba-a8e4-a11f6bdf8048 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:51:54.076280 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.wsgi [None req-0777693e-2444-44ba-a8e4-a11f6bdf8048 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] HTTP exception thrown: Instance a8a8352c-4f05-4640-a976-edb025819089 could not be found. Jun 07 14:51:54.077887 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-0777693e-2444-44ba-a8e4-a11f6bdf8048 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Request method failure captured: Jun 07 14:51:54.077887 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: request: DELETE /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 HTTP/1.1 Jun 07 14:51:54.077887 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Accept: application/json Jun 07 14:51:54.077887 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Accept-Encoding: identity Jun 07 14:51:54.077887 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Connection: close Jun 07 14:51:54.077887 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Content-Length: 0 Jun 07 14:51:54.077887 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Content-Type: application/json Jun 07 14:51:54.077887 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Host: 10.222.0.85 Jun 07 14:51:54.077887 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Openstack-System-Scope: None Jun 07 14:51:54.077887 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: User-Agent: python-urllib3/1.26.9 Jun 07 14:51:54.077887 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Auth-Token: gAAAAABin2N4eg8ljLkujTllXmla-f9Utwkro_n2NGvX66R0WQ3VhG9X255DHwF93uP2eLCGyu4YzGgS25vgqUptMxS_YvCNFIrvRsHolae3yVnlb5rJduKT46NpWaBuq7E5pf08GFOQq58grSyxOEnc51TMZmGRHSL2y5vODYb6A4UfzXPec-g Jun 07 14:51:54.077887 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Domain-Id: None Jun 07 14:51:54.077887 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Domain-Name: None Jun 07 14:51:54.077887 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Identity-Status: Confirmed Jun 07 14:51:54.077887 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Is-Admin-Project: True Jun 07 14:51:54.077887 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Openstack-Nova-Api-Version: 2.20 Jun 07 14:51:54.077887 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Domain-Id: default Jun 07 14:51:54.077887 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Domain-Name: Default Jun 07 14:51:54.077887 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Id: 6714e8cfaee34ac3af916af5e4bb1031 Jun 07 14:51:54.077887 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-550906303 Jun 07 14:51:54.077887 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Role: member,reader Jun 07 14:51:54.077887 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Roles: member,reader Jun 07 14:51:54.079399 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/6714e8cfaee34ac3af916af5e4bb1031"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_6714e8cfaee34ac3af916af5e4bb1031"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/6714e8cfaee34ac3af916af5e4bb1031"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/6714e8cfaee34ac3af916af5e4bb1031"}]}] Jun 07 14:51:54.079399 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Tenant: tempest-AttachVolumeShelveTestJSON-550906303 Jun 07 14:51:54.079399 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Tenant-Id: 6714e8cfaee34ac3af916af5e4bb1031 Jun 07 14:51:54.079399 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-550906303 Jun 07 14:51:54.079399 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User: tempest-AttachVolumeShelveTestJSON-550906303-project Jun 07 14:51:54.079399 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Domain-Id: default Jun 07 14:51:54.079399 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Domain-Name: Default Jun 07 14:51:54.079399 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Id: ed3353d3d8a242e1a6b54d31adf97a6d Jun 07 14:51:54.079399 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Name: tempest-AttachVolumeShelveTestJSON-550906303-project Jun 07 14:51:54.079399 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: method: > Jun 07 14:51:54.079399 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: exception: Instance a8a8352c-4f05-4640-a976-edb025819089 could not be found. Jun 07 14:51:54.079399 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: action_args: {'id': 'a8a8352c-4f05-4640-a976-edb025819089'} Jun 07 14:51:54.083666 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:51:54.083666 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:51:54.083666 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 14:51:54.083666 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 14:51:54.083666 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 14:51:54.083666 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 14:51:54.083666 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 14:51:54.083666 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 14:51:54.083666 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 14:51:54.083666 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 14:51:54.083666 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8a8352c-4f05-4640-a976-edb025819089 could not be found. Jun 07 14:51:54.083666 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:51:54.083666 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:51:54.083666 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:51:54.083666 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:51:54.083666 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:51:54.083666 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:51:54.083666 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:51:54.083666 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:51:54.083666 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:51:54.085429 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:51:54.085429 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 07 14:51:54.085429 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 07 14:51:54.085429 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 07 14:51:54.085429 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 07 14:51:54.085429 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 14:51:54.085429 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 14:51:54.085429 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 14:51:54.085429 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:51:54.085429 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8a8352c-4f05-4640-a976-edb025819089 could not be found. Jun 07 14:51:54.085429 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:51:54.085429 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:51:54.085429 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:51:54.085429 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:51:54.085429 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:51:54.085429 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:51:54.085429 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:51:54.085429 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:51:54.085429 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8a8352c-4f05-4640-a976-edb025819089 could not be found. Jun 07 14:51:54.085429 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:51:54.086976 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-0777693e-2444-44ba-a8e4-a11f6bdf8048 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Returning 404 to user: Instance a8a8352c-4f05-4640-a976-edb025819089 could not be found. {{(pid=118158) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:51:54.086976 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-0777693e-2444-44ba-a8e4-a11f6bdf8048 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "DELETE /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 404 len: 111 microversion: 2.20 time: 0.029454 Jun 07 14:51:54.086976 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 561/1112] 10.222.0.85 () {60 vars in 1279 bytes} [Tue Jun 7 14:51:54 2022] DELETE /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 07 14:51:54.090522 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-a7a08e7b-a57d-4d00-b1d8-4b359daec873 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:51:54.091139 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-a7a08e7b-a57d-4d00-b1d8-4b359daec873 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] [instance: a8a8352c-4f05-4640-a976-edb025819089] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:51:54.097722 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-a7a08e7b-a57d-4d00-b1d8-4b359daec873 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:51:54.098173 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-a7a08e7b-a57d-4d00-b1d8-4b359daec873 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:51:54.098934 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-a7a08e7b-a57d-4d00-b1d8-4b359daec873 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:51:54.099373 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-a7a08e7b-a57d-4d00-b1d8-4b359daec873 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:51:54.116931 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.wsgi [None req-a7a08e7b-a57d-4d00-b1d8-4b359daec873 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] HTTP exception thrown: Instance a8a8352c-4f05-4640-a976-edb025819089 could not be found. Jun 07 14:51:54.118479 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-a7a08e7b-a57d-4d00-b1d8-4b359daec873 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Request method failure captured: Jun 07 14:51:54.118479 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: request: GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 HTTP/1.1 Jun 07 14:51:54.118479 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Accept: application/json Jun 07 14:51:54.118479 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Accept-Encoding: identity Jun 07 14:51:54.118479 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Connection: close Jun 07 14:51:54.118479 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Content-Length: 0 Jun 07 14:51:54.118479 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Content-Type: application/json Jun 07 14:51:54.118479 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Host: 10.222.0.85 Jun 07 14:51:54.118479 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Openstack-System-Scope: None Jun 07 14:51:54.118479 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: User-Agent: python-urllib3/1.26.9 Jun 07 14:51:54.118479 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Auth-Token: gAAAAABin2N4eg8ljLkujTllXmla-f9Utwkro_n2NGvX66R0WQ3VhG9X255DHwF93uP2eLCGyu4YzGgS25vgqUptMxS_YvCNFIrvRsHolae3yVnlb5rJduKT46NpWaBuq7E5pf08GFOQq58grSyxOEnc51TMZmGRHSL2y5vODYb6A4UfzXPec-g Jun 07 14:51:54.118479 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Domain-Id: None Jun 07 14:51:54.118479 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Domain-Name: None Jun 07 14:51:54.118479 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Identity-Status: Confirmed Jun 07 14:51:54.118479 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Is-Admin-Project: True Jun 07 14:51:54.118479 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Openstack-Nova-Api-Version: 2.20 Jun 07 14:51:54.118479 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Project-Domain-Id: default Jun 07 14:51:54.118479 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Project-Domain-Name: Default Jun 07 14:51:54.118479 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Project-Id: 6714e8cfaee34ac3af916af5e4bb1031 Jun 07 14:51:54.118479 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-550906303 Jun 07 14:51:54.118479 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Role: member,reader Jun 07 14:51:54.118479 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Roles: member,reader Jun 07 14:51:54.121260 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/6714e8cfaee34ac3af916af5e4bb1031"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_6714e8cfaee34ac3af916af5e4bb1031"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/6714e8cfaee34ac3af916af5e4bb1031"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/6714e8cfaee34ac3af916af5e4bb1031"}]}] Jun 07 14:51:54.121260 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Tenant: tempest-AttachVolumeShelveTestJSON-550906303 Jun 07 14:51:54.121260 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Tenant-Id: 6714e8cfaee34ac3af916af5e4bb1031 Jun 07 14:51:54.121260 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-550906303 Jun 07 14:51:54.121260 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User: tempest-AttachVolumeShelveTestJSON-550906303-project Jun 07 14:51:54.121260 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User-Domain-Id: default Jun 07 14:51:54.121260 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User-Domain-Name: Default Jun 07 14:51:54.121260 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User-Id: ed3353d3d8a242e1a6b54d31adf97a6d Jun 07 14:51:54.121260 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User-Name: tempest-AttachVolumeShelveTestJSON-550906303-project Jun 07 14:51:54.121260 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: method: > Jun 07 14:51:54.121260 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: exception: Instance a8a8352c-4f05-4640-a976-edb025819089 could not be found. Jun 07 14:51:54.121260 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: action_args: {'id': 'a8a8352c-4f05-4640-a976-edb025819089'} Jun 07 14:51:54.122074 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:51:54.122074 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:51:54.122074 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 14:51:54.122074 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 14:51:54.122074 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 14:51:54.122074 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 14:51:54.122074 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 14:51:54.122074 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 14:51:54.122074 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 14:51:54.122074 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 14:51:54.122074 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8a8352c-4f05-4640-a976-edb025819089 could not be found. Jun 07 14:51:54.122074 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:51:54.122074 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:51:54.122074 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:51:54.122074 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:51:54.122074 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:51:54.122074 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:51:54.122074 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:51:54.122074 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:51:54.122074 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:51:54.123306 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:51:54.123306 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 14:51:54.123306 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 14:51:54.123306 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 14:51:54.123306 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 14:51:54.123306 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 14:51:54.123306 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:51:54.123306 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8a8352c-4f05-4640-a976-edb025819089 could not be found. Jun 07 14:51:54.123306 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:51:54.123306 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:51:54.123306 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:51:54.123306 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:51:54.123306 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:51:54.123306 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:51:54.123306 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:51:54.123306 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:51:54.123306 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8a8352c-4f05-4640-a976-edb025819089 could not be found. Jun 07 14:51:54.123306 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:51:54.125108 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-a7a08e7b-a57d-4d00-b1d8-4b359daec873 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] Returning 404 to user: Instance a8a8352c-4f05-4640-a976-edb025819089 could not be found. {{(pid=118157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:51:54.125108 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-a7a08e7b-a57d-4d00-b1d8-4b359daec873 tempest-AttachVolumeShelveTestJSON-550906303 tempest-AttachVolumeShelveTestJSON-550906303-project] 10.222.0.85 "GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089" status: 404 len: 111 microversion: 2.20 time: 0.033379 Jun 07 14:51:54.125108 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 552/1113] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jun 7 14:51:54 2022] GET /compute/v2.1/servers/a8a8352c-4f05-4640-a976-edb025819089 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 07 14:52:00.135376 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-690add40-2348-41f9-929b-da5209b529b7 tempest-VolumesNegativeTest-200339889 tempest-VolumesNegativeTest-200339889-project] Action: 'create', calling method: .version_select at 0x7f5f88140c10>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1133682399", "metadata": {"Type": "work"}}} {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:52:00.150311 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-690add40-2348-41f9-929b-da5209b529b7 tempest-VolumesNegativeTest-200339889 tempest-VolumesNegativeTest-200339889-project] Request method failure captured: Jun 07 14:52:00.150311 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 07 14:52:00.150311 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Accept: application/json Jun 07 14:52:00.150311 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Accept-Encoding: identity Jun 07 14:52:00.150311 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Connection: close Jun 07 14:52:00.150311 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Content-Length: 122 Jun 07 14:52:00.150311 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Content-Type: application/json Jun 07 14:52:00.150311 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Host: 10.222.0.85 Jun 07 14:52:00.150311 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Openstack-System-Scope: None Jun 07 14:52:00.150311 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: User-Agent: python-urllib3/1.26.9 Jun 07 14:52:00.150311 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Auth-Token: gAAAAABin2YPwKOueyo-mNOQ8ui9XiX3pjColfvx63KfQV_93uTvHJnUC_rWZwCyCiLpuoLit6o00YBVx8kRb0vIxEs-Fh1JMty6XoVkYRFnA0XuX8vdsjWEaq-B0A6_zjrj2r3udY1DxVQj44-OVvchJB1KX15N4igcIYRMN5arXHd4FNrXV-4 Jun 07 14:52:00.150311 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Domain-Id: None Jun 07 14:52:00.150311 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Domain-Name: None Jun 07 14:52:00.150311 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Identity-Status: Confirmed Jun 07 14:52:00.150311 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Is-Admin-Project: True Jun 07 14:52:00.150311 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Domain-Id: default Jun 07 14:52:00.150311 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Domain-Name: Default Jun 07 14:52:00.150311 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Id: fc7a18c877864f6a91cafd369105bcfa Jun 07 14:52:00.150311 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Name: tempest-VolumesNegativeTest-200339889 Jun 07 14:52:00.150311 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Role: member,reader Jun 07 14:52:00.150311 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Roles: member,reader Jun 07 14:52:00.152457 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/fc7a18c877864f6a91cafd369105bcfa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_fc7a18c877864f6a91cafd369105bcfa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/fc7a18c877864f6a91cafd369105bcfa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/fc7a18c877864f6a91cafd369105bcfa"}]}] Jun 07 14:52:00.152457 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Tenant: tempest-VolumesNegativeTest-200339889 Jun 07 14:52:00.152457 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Tenant-Id: fc7a18c877864f6a91cafd369105bcfa Jun 07 14:52:00.152457 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Tenant-Name: tempest-VolumesNegativeTest-200339889 Jun 07 14:52:00.152457 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User: tempest-VolumesNegativeTest-200339889-project Jun 07 14:52:00.152457 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Domain-Id: default Jun 07 14:52:00.152457 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Domain-Name: Default Jun 07 14:52:00.152457 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Id: be9dec3c8efc4ab580ab02d3fd6b3e4c Jun 07 14:52:00.152457 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Name: tempest-VolumesNegativeTest-200339889-project Jun 07 14:52:00.152457 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Jun 07 14:52:00.152457 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1133682399", "metadata": {"Type": "work"}}} Jun 07 14:52:00.152457 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: method: Jun 07 14:52:00.152457 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 07 14:52:00.157815 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1133682399', 'metadata': {'Type': 'work'}}}} Jun 07 14:52:00.157815 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:52:00.157815 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:52:00.157815 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 07 14:52:00.157815 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 07 14:52:00.157815 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 07 14:52:00.157815 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi raise error Jun 07 14:52:00.157815 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 07 14:52:00.157815 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:52:00.157815 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 07 14:52:00.157815 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 07 14:52:00.157815 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:52:00.157815 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 07 14:52:00.157815 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi '#$%' Jun 07 14:52:00.157815 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:52:00.157815 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:52:00.157815 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:52:00.157815 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:52:00.157815 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:52:00.157815 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:52:00.157815 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:52:00.157815 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:52:00.159614 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 14:52:00.159614 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 14:52:00.159614 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:52:00.159614 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:52:00.159614 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 07 14:52:00.159614 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 07 14:52:00.159614 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 07 14:52:00.159614 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 07 14:52:00.159614 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 07 14:52:00.159614 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 07 14:52:00.159614 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 07 14:52:00.159614 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:52:00.159614 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:52:00.159614 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:52:00.159614 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:52:00.159614 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:52:00.159614 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:52:00.159614 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 07 14:52:00.159614 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 07 14:52:00.161126 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 07 14:52:00.161126 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:52:00.161126 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-690add40-2348-41f9-929b-da5209b529b7 tempest-VolumesNegativeTest-200339889 tempest-VolumesNegativeTest-200339889-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118158) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:52:00.161126 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-690add40-2348-41f9-929b-da5209b529b7 tempest-VolumesNegativeTest-200339889 tempest-VolumesNegativeTest-200339889-project] 10.222.0.85 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.134181 Jun 07 14:52:00.161126 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 562/1114] 10.222.0.85 () {60 vars in 1155 bytes} [Tue Jun 7 14:52:00 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 136 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 07 14:52:00.162883 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-55e9eb67-6c62-469a-bd86-3cff028fc1ae tempest-VolumesNegativeTest-200339889 tempest-VolumesNegativeTest-200339889-project] Action: 'create', calling method: .version_select at 0x7f5f8825ac10>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1902919001", "metadata": {"Type": "work"}}} {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:52:00.166088 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-55e9eb67-6c62-469a-bd86-3cff028fc1ae tempest-VolumesNegativeTest-200339889 tempest-VolumesNegativeTest-200339889-project] Request method failure captured: Jun 07 14:52:00.166088 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 07 14:52:00.166088 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Accept: application/json Jun 07 14:52:00.166088 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Accept-Encoding: identity Jun 07 14:52:00.166088 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Connection: close Jun 07 14:52:00.166088 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Content-Length: 120 Jun 07 14:52:00.166088 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Content-Type: application/json Jun 07 14:52:00.166088 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Host: 10.222.0.85 Jun 07 14:52:00.166088 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Openstack-System-Scope: None Jun 07 14:52:00.166088 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: User-Agent: python-urllib3/1.26.9 Jun 07 14:52:00.166088 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Auth-Token: gAAAAABin2YPwKOueyo-mNOQ8ui9XiX3pjColfvx63KfQV_93uTvHJnUC_rWZwCyCiLpuoLit6o00YBVx8kRb0vIxEs-Fh1JMty6XoVkYRFnA0XuX8vdsjWEaq-B0A6_zjrj2r3udY1DxVQj44-OVvchJB1KX15N4igcIYRMN5arXHd4FNrXV-4 Jun 07 14:52:00.166088 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Domain-Id: None Jun 07 14:52:00.166088 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Domain-Name: None Jun 07 14:52:00.166088 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Identity-Status: Confirmed Jun 07 14:52:00.166088 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Is-Admin-Project: True Jun 07 14:52:00.166088 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Project-Domain-Id: default Jun 07 14:52:00.166088 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Project-Domain-Name: Default Jun 07 14:52:00.166088 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Project-Id: fc7a18c877864f6a91cafd369105bcfa Jun 07 14:52:00.166088 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Project-Name: tempest-VolumesNegativeTest-200339889 Jun 07 14:52:00.166088 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Role: member,reader Jun 07 14:52:00.166088 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Roles: member,reader Jun 07 14:52:00.167670 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/fc7a18c877864f6a91cafd369105bcfa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_fc7a18c877864f6a91cafd369105bcfa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/fc7a18c877864f6a91cafd369105bcfa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/fc7a18c877864f6a91cafd369105bcfa"}]}] Jun 07 14:52:00.167670 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Tenant: tempest-VolumesNegativeTest-200339889 Jun 07 14:52:00.167670 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Tenant-Id: fc7a18c877864f6a91cafd369105bcfa Jun 07 14:52:00.167670 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Tenant-Name: tempest-VolumesNegativeTest-200339889 Jun 07 14:52:00.167670 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User: tempest-VolumesNegativeTest-200339889-project Jun 07 14:52:00.167670 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User-Domain-Id: default Jun 07 14:52:00.167670 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User-Domain-Name: Default Jun 07 14:52:00.167670 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User-Id: be9dec3c8efc4ab580ab02d3fd6b3e4c Jun 07 14:52:00.167670 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User-Name: tempest-VolumesNegativeTest-200339889-project Jun 07 14:52:00.167670 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Jun 07 14:52:00.167670 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1902919001", "metadata": {"Type": "work"}}} Jun 07 14:52:00.167670 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: method: Jun 07 14:52:00.167670 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 07 14:52:00.168899 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1902919001', 'metadata': {'Type': 'work'}}}} Jun 07 14:52:00.168899 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:52:00.168899 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:52:00.168899 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 07 14:52:00.168899 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 07 14:52:00.168899 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 07 14:52:00.168899 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi raise error Jun 07 14:52:00.168899 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 07 14:52:00.168899 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:52:00.168899 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 07 14:52:00.168899 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 07 14:52:00.168899 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:52:00.168899 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 07 14:52:00.168899 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi '0' Jun 07 14:52:00.168899 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:52:00.168899 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:52:00.168899 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:52:00.168899 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:52:00.168899 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:52:00.168899 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:52:00.168899 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:52:00.168899 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:52:00.170495 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 14:52:00.170495 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 14:52:00.170495 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:52:00.170495 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:52:00.170495 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 07 14:52:00.170495 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 07 14:52:00.170495 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 07 14:52:00.170495 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 07 14:52:00.170495 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 07 14:52:00.170495 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 07 14:52:00.170495 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 07 14:52:00.170495 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:52:00.170495 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:52:00.170495 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:52:00.170495 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:52:00.170495 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:52:00.170495 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:52:00.170495 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 07 14:52:00.170495 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 07 14:52:00.171873 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 07 14:52:00.171873 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:52:00.171873 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-55e9eb67-6c62-469a-bd86-3cff028fc1ae tempest-VolumesNegativeTest-200339889 tempest-VolumesNegativeTest-200339889-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:52:00.171873 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-55e9eb67-6c62-469a-bd86-3cff028fc1ae tempest-VolumesNegativeTest-200339889 tempest-VolumesNegativeTest-200339889-project] 10.222.0.85 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.008448 Jun 07 14:52:00.171873 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 553/1115] 10.222.0.85 () {60 vars in 1155 bytes} [Tue Jun 7 14:52:00 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 07 14:52:00.177495 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-97491487-8064-4eef-a434-0e14a103efb5 tempest-VolumesNegativeTest-200339889 tempest-VolumesNegativeTest-200339889-project] Action: 'create', calling method: .version_select at 0x7f5f8c150790>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1936944196", "metadata": {"Type": "work"}}} {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:52:00.180912 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-97491487-8064-4eef-a434-0e14a103efb5 tempest-VolumesNegativeTest-200339889 tempest-VolumesNegativeTest-200339889-project] Request method failure captured: Jun 07 14:52:00.180912 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 07 14:52:00.180912 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Accept: application/json Jun 07 14:52:00.180912 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Accept-Encoding: identity Jun 07 14:52:00.180912 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Connection: close Jun 07 14:52:00.180912 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Content-Length: 119 Jun 07 14:52:00.180912 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Content-Type: application/json Jun 07 14:52:00.180912 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Host: 10.222.0.85 Jun 07 14:52:00.180912 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Openstack-System-Scope: None Jun 07 14:52:00.180912 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: User-Agent: python-urllib3/1.26.9 Jun 07 14:52:00.180912 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Auth-Token: gAAAAABin2YPwKOueyo-mNOQ8ui9XiX3pjColfvx63KfQV_93uTvHJnUC_rWZwCyCiLpuoLit6o00YBVx8kRb0vIxEs-Fh1JMty6XoVkYRFnA0XuX8vdsjWEaq-B0A6_zjrj2r3udY1DxVQj44-OVvchJB1KX15N4igcIYRMN5arXHd4FNrXV-4 Jun 07 14:52:00.180912 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Domain-Id: None Jun 07 14:52:00.180912 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Domain-Name: None Jun 07 14:52:00.180912 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Identity-Status: Confirmed Jun 07 14:52:00.180912 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Is-Admin-Project: True Jun 07 14:52:00.180912 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Domain-Id: default Jun 07 14:52:00.180912 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Domain-Name: Default Jun 07 14:52:00.180912 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Id: fc7a18c877864f6a91cafd369105bcfa Jun 07 14:52:00.180912 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Name: tempest-VolumesNegativeTest-200339889 Jun 07 14:52:00.180912 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Role: member,reader Jun 07 14:52:00.180912 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Roles: member,reader Jun 07 14:52:00.182623 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/fc7a18c877864f6a91cafd369105bcfa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_fc7a18c877864f6a91cafd369105bcfa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/fc7a18c877864f6a91cafd369105bcfa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/fc7a18c877864f6a91cafd369105bcfa"}]}] Jun 07 14:52:00.182623 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Tenant: tempest-VolumesNegativeTest-200339889 Jun 07 14:52:00.182623 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Tenant-Id: fc7a18c877864f6a91cafd369105bcfa Jun 07 14:52:00.182623 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Tenant-Name: tempest-VolumesNegativeTest-200339889 Jun 07 14:52:00.182623 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User: tempest-VolumesNegativeTest-200339889-project Jun 07 14:52:00.182623 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Domain-Id: default Jun 07 14:52:00.182623 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Domain-Name: Default Jun 07 14:52:00.182623 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Id: be9dec3c8efc4ab580ab02d3fd6b3e4c Jun 07 14:52:00.182623 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Name: tempest-VolumesNegativeTest-200339889-project Jun 07 14:52:00.182623 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Jun 07 14:52:00.182623 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1936944196", "metadata": {"Type": "work"}}} Jun 07 14:52:00.182623 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: method: Jun 07 14:52:00.182623 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 07 14:52:00.186610 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1936944196', 'metadata': {'Type': 'work'}}}} Jun 07 14:52:00.186610 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:52:00.186610 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:52:00.186610 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 07 14:52:00.186610 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 07 14:52:00.186610 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 07 14:52:00.186610 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi raise error Jun 07 14:52:00.186610 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 07 14:52:00.186610 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:52:00.186610 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 07 14:52:00.186610 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 07 14:52:00.186610 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:52:00.186610 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 07 14:52:00.186610 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi '' Jun 07 14:52:00.186610 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:52:00.186610 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:52:00.186610 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:52:00.186610 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:52:00.186610 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:52:00.186610 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:52:00.186610 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:52:00.186610 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:52:00.188736 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 14:52:00.188736 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 14:52:00.188736 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:52:00.188736 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:52:00.188736 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 07 14:52:00.188736 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 07 14:52:00.188736 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 07 14:52:00.188736 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 07 14:52:00.188736 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 07 14:52:00.188736 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 07 14:52:00.188736 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 07 14:52:00.188736 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:52:00.188736 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:52:00.188736 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:52:00.188736 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:52:00.188736 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:52:00.188736 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:52:00.188736 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 07 14:52:00.188736 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 07 14:52:00.190301 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 07 14:52:00.190301 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:52:00.190301 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-97491487-8064-4eef-a434-0e14a103efb5 tempest-VolumesNegativeTest-200339889 tempest-VolumesNegativeTest-200339889-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118158) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:52:00.190301 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-97491487-8064-4eef-a434-0e14a103efb5 tempest-VolumesNegativeTest-200339889 tempest-VolumesNegativeTest-200339889-project] 10.222.0.85 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008712 Jun 07 14:52:00.190301 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 563/1116] 10.222.0.85 () {60 vars in 1155 bytes} [Tue Jun 7 14:52:00 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 07 14:52:00.193402 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-12a5744e-1b25-40bc-ac1b-e3a7c9b9bf99 tempest-VolumesNegativeTest-200339889 tempest-VolumesNegativeTest-200339889-project] Calling method '.version_select at 0x7f5f88295e50>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:52:00.225509 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.wsgi [None req-12a5744e-1b25-40bc-ac1b-e3a7c9b9bf99 tempest-VolumesNegativeTest-200339889 tempest-VolumesNegativeTest-200339889-project] HTTP exception thrown: Volume tempest-invalid-448342160 could not be found. Jun 07 14:52:00.227471 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-12a5744e-1b25-40bc-ac1b-e3a7c9b9bf99 tempest-VolumesNegativeTest-200339889 tempest-VolumesNegativeTest-200339889-project] Request method failure captured: Jun 07 14:52:00.227471 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-448342160 HTTP/1.1 Jun 07 14:52:00.227471 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Accept: application/json Jun 07 14:52:00.227471 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Accept-Encoding: identity Jun 07 14:52:00.227471 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Connection: close Jun 07 14:52:00.227471 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Content-Length: 0 Jun 07 14:52:00.227471 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Content-Type: application/json Jun 07 14:52:00.227471 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Host: 10.222.0.85 Jun 07 14:52:00.227471 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Openstack-System-Scope: None Jun 07 14:52:00.227471 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: User-Agent: python-urllib3/1.26.9 Jun 07 14:52:00.227471 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Auth-Token: gAAAAABin2YPwKOueyo-mNOQ8ui9XiX3pjColfvx63KfQV_93uTvHJnUC_rWZwCyCiLpuoLit6o00YBVx8kRb0vIxEs-Fh1JMty6XoVkYRFnA0XuX8vdsjWEaq-B0A6_zjrj2r3udY1DxVQj44-OVvchJB1KX15N4igcIYRMN5arXHd4FNrXV-4 Jun 07 14:52:00.227471 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Domain-Id: None Jun 07 14:52:00.227471 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Domain-Name: None Jun 07 14:52:00.227471 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Identity-Status: Confirmed Jun 07 14:52:00.227471 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Is-Admin-Project: True Jun 07 14:52:00.227471 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Project-Domain-Id: default Jun 07 14:52:00.227471 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Project-Domain-Name: Default Jun 07 14:52:00.227471 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Project-Id: fc7a18c877864f6a91cafd369105bcfa Jun 07 14:52:00.227471 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Project-Name: tempest-VolumesNegativeTest-200339889 Jun 07 14:52:00.227471 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Role: member,reader Jun 07 14:52:00.227471 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Roles: member,reader Jun 07 14:52:00.229091 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/fc7a18c877864f6a91cafd369105bcfa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_fc7a18c877864f6a91cafd369105bcfa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/fc7a18c877864f6a91cafd369105bcfa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/fc7a18c877864f6a91cafd369105bcfa"}]}] Jun 07 14:52:00.229091 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Tenant: tempest-VolumesNegativeTest-200339889 Jun 07 14:52:00.229091 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Tenant-Id: fc7a18c877864f6a91cafd369105bcfa Jun 07 14:52:00.229091 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Tenant-Name: tempest-VolumesNegativeTest-200339889 Jun 07 14:52:00.229091 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User: tempest-VolumesNegativeTest-200339889-project Jun 07 14:52:00.229091 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User-Domain-Id: default Jun 07 14:52:00.229091 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User-Domain-Name: Default Jun 07 14:52:00.229091 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User-Id: be9dec3c8efc4ab580ab02d3fd6b3e4c Jun 07 14:52:00.229091 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User-Name: tempest-VolumesNegativeTest-200339889-project Jun 07 14:52:00.229091 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: method: Jun 07 14:52:00.229091 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: exception: Volume tempest-invalid-448342160 could not be found. Jun 07 14:52:00.229091 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: action_args: {'id': 'tempest-invalid-448342160'} Jun 07 14:52:00.229091 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:52:00.230071 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:52:00.230071 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 14:52:00.230071 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 14:52:00.230071 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 07 14:52:00.230071 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 07 14:52:00.230071 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 07 14:52:00.230071 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 07 14:52:00.230071 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 07 14:52:00.230071 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 07 14:52:00.230071 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 07 14:52:00.230071 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 07 14:52:00.230071 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 14:52:00.230071 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 14:52:00.230071 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 14:52:00.230071 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 14:52:00.230071 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-448342160 could not be found. (HTTP 404) (Request-ID: req-c9d22e91-6fdf-43e2-adc4-c26f197f3d65) Jun 07 14:52:00.230071 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:52:00.230071 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:52:00.230071 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:52:00.231507 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:52:00.231507 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 07 14:52:00.231507 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 07 14:52:00.231507 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 07 14:52:00.231507 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 07 14:52:00.231507 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 07 14:52:00.231507 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 07 14:52:00.231507 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 07 14:52:00.231507 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 07 14:52:00.231507 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 14:52:00.231507 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 14:52:00.231507 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 07 14:52:00.231507 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 07 14:52:00.231507 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 07 14:52:00.231507 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 07 14:52:00.231507 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 07 14:52:00.231507 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 07 14:52:00.231507 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 07 14:52:00.231507 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 07 14:52:00.233117 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 14:52:00.233117 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 14:52:00.233117 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 14:52:00.233117 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 14:52:00.233117 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-448342160 could not be found. Jun 07 14:52:00.233117 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:52:00.233117 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:52:00.233117 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:52:00.233117 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:52:00.233117 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:52:00.233117 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:52:00.233117 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:52:00.233117 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:52:00.233117 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 14:52:00.233117 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 14:52:00.233117 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:52:00.233117 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:52:00.233117 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 07 14:52:00.233117 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:52:00.233117 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-448342160 could not be found. Jun 07 14:52:00.234864 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:52:00.234864 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:52:00.234864 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:52:00.234864 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:52:00.234864 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:52:00.234864 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:52:00.234864 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:52:00.234864 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:52:00.234864 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-448342160 could not be found. Jun 07 14:52:00.234864 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:52:00.234864 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-12a5744e-1b25-40bc-ac1b-e3a7c9b9bf99 tempest-VolumesNegativeTest-200339889 tempest-VolumesNegativeTest-200339889-project] Returning 404 to user: Volume tempest-invalid-448342160 could not be found. {{(pid=118157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:52:00.234864 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-12a5744e-1b25-40bc-ac1b-e3a7c9b9bf99 tempest-VolumesNegativeTest-200339889 tempest-VolumesNegativeTest-200339889-project] 10.222.0.85 "DELETE /compute/v2.1/os-volumes/tempest-invalid-448342160" status: 404 len: 98 microversion: 2.1 time: 0.039408 Jun 07 14:52:00.234864 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 554/1117] 10.222.0.85 () {58 vars in 1214 bytes} [Tue Jun 7 14:52:00 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-448342160 => generated 98 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 07 14:52:00.239713 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-c71b51ad-e972-4f80-b9a9-2f6e60e95edd tempest-VolumesNegativeTest-200339889 tempest-VolumesNegativeTest-200339889-project] 10.222.0.85 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003690 Jun 07 14:52:00.240402 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 564/1118] 10.222.0.85 () {58 vars in 1139 bytes} [Tue Jun 7 14:52:00 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jun 07 14:52:00.249090 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-9b3e5714-fd0a-459a-879f-71c682ea1563 tempest-VolumesNegativeTest-200339889 tempest-VolumesNegativeTest-200339889-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003792 Jun 07 14:52:00.249589 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 555/1119] 10.222.0.85 () {58 vars in 1136 bytes} [Tue Jun 7 14:52:00 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 07 14:52:00.262554 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-e77166e6-a434-44da-bc98-fea44a19e0d1 tempest-VolumesNegativeTest-200339889 tempest-VolumesNegativeTest-200339889-project] Calling method '.version_select at 0x7f5f88140c10>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:52:00.291899 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.wsgi [None req-e77166e6-a434-44da-bc98-fea44a19e0d1 tempest-VolumesNegativeTest-200339889 tempest-VolumesNegativeTest-200339889-project] HTTP exception thrown: Volume 14e43aee-c840-47cb-9668-3bdeea0e08da could not be found. Jun 07 14:52:00.293915 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-e77166e6-a434-44da-bc98-fea44a19e0d1 tempest-VolumesNegativeTest-200339889 tempest-VolumesNegativeTest-200339889-project] Request method failure captured: Jun 07 14:52:00.293915 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: request: DELETE /compute/v2.1/os-volumes/14e43aee-c840-47cb-9668-3bdeea0e08da HTTP/1.1 Jun 07 14:52:00.293915 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Accept: application/json Jun 07 14:52:00.293915 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Accept-Encoding: identity Jun 07 14:52:00.293915 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Connection: close Jun 07 14:52:00.293915 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Content-Length: 0 Jun 07 14:52:00.293915 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Content-Type: application/json Jun 07 14:52:00.293915 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Host: 10.222.0.85 Jun 07 14:52:00.293915 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Openstack-System-Scope: None Jun 07 14:52:00.293915 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: User-Agent: python-urllib3/1.26.9 Jun 07 14:52:00.293915 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Auth-Token: gAAAAABin2YPwKOueyo-mNOQ8ui9XiX3pjColfvx63KfQV_93uTvHJnUC_rWZwCyCiLpuoLit6o00YBVx8kRb0vIxEs-Fh1JMty6XoVkYRFnA0XuX8vdsjWEaq-B0A6_zjrj2r3udY1DxVQj44-OVvchJB1KX15N4igcIYRMN5arXHd4FNrXV-4 Jun 07 14:52:00.293915 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Domain-Id: None Jun 07 14:52:00.293915 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Domain-Name: None Jun 07 14:52:00.293915 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Identity-Status: Confirmed Jun 07 14:52:00.293915 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Is-Admin-Project: True Jun 07 14:52:00.293915 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Domain-Id: default Jun 07 14:52:00.293915 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Domain-Name: Default Jun 07 14:52:00.293915 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Id: fc7a18c877864f6a91cafd369105bcfa Jun 07 14:52:00.293915 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Name: tempest-VolumesNegativeTest-200339889 Jun 07 14:52:00.293915 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Role: member,reader Jun 07 14:52:00.293915 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Roles: member,reader Jun 07 14:52:00.295485 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/fc7a18c877864f6a91cafd369105bcfa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_fc7a18c877864f6a91cafd369105bcfa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/fc7a18c877864f6a91cafd369105bcfa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/fc7a18c877864f6a91cafd369105bcfa"}]}] Jun 07 14:52:00.295485 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Tenant: tempest-VolumesNegativeTest-200339889 Jun 07 14:52:00.295485 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Tenant-Id: fc7a18c877864f6a91cafd369105bcfa Jun 07 14:52:00.295485 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Tenant-Name: tempest-VolumesNegativeTest-200339889 Jun 07 14:52:00.295485 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User: tempest-VolumesNegativeTest-200339889-project Jun 07 14:52:00.295485 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Domain-Id: default Jun 07 14:52:00.295485 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Domain-Name: Default Jun 07 14:52:00.295485 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Id: be9dec3c8efc4ab580ab02d3fd6b3e4c Jun 07 14:52:00.295485 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Name: tempest-VolumesNegativeTest-200339889-project Jun 07 14:52:00.295485 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: method: Jun 07 14:52:00.295485 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: exception: Volume 14e43aee-c840-47cb-9668-3bdeea0e08da could not be found. Jun 07 14:52:00.295485 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: action_args: {'id': '14e43aee-c840-47cb-9668-3bdeea0e08da'} Jun 07 14:52:00.295485 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:52:00.296591 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:52:00.296591 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 14:52:00.296591 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 14:52:00.296591 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 07 14:52:00.296591 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 07 14:52:00.296591 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 07 14:52:00.296591 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 07 14:52:00.296591 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 07 14:52:00.296591 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 07 14:52:00.296591 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 07 14:52:00.296591 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 07 14:52:00.296591 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 14:52:00.296591 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 14:52:00.296591 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 14:52:00.296591 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 14:52:00.296591 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 14e43aee-c840-47cb-9668-3bdeea0e08da could not be found. (HTTP 404) (Request-ID: req-2a881e15-a8c9-4faf-a567-06edb7578102) Jun 07 14:52:00.296591 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:52:00.296591 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:52:00.296591 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:52:00.297850 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:52:00.297850 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 07 14:52:00.297850 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 07 14:52:00.297850 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 07 14:52:00.297850 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 07 14:52:00.297850 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 07 14:52:00.297850 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 07 14:52:00.297850 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 07 14:52:00.297850 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 07 14:52:00.297850 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 14:52:00.297850 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 14:52:00.297850 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 07 14:52:00.297850 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 07 14:52:00.297850 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 07 14:52:00.297850 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 07 14:52:00.297850 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 07 14:52:00.297850 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 07 14:52:00.297850 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 07 14:52:00.297850 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 07 14:52:00.299029 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 14:52:00.299029 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 14:52:00.299029 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 14:52:00.299029 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 14:52:00.299029 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 14e43aee-c840-47cb-9668-3bdeea0e08da could not be found. Jun 07 14:52:00.299029 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:52:00.299029 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:52:00.299029 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:52:00.299029 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:52:00.299029 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:52:00.299029 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:52:00.299029 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:52:00.299029 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:52:00.299029 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 14:52:00.299029 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 14:52:00.299029 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:52:00.299029 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:52:00.299029 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 07 14:52:00.299029 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:52:00.300283 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 14e43aee-c840-47cb-9668-3bdeea0e08da could not be found. Jun 07 14:52:00.300283 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:52:00.300283 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:52:00.300283 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:52:00.300283 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:52:00.300283 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:52:00.300283 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:52:00.300283 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:52:00.300283 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:52:00.300283 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 14e43aee-c840-47cb-9668-3bdeea0e08da could not be found. Jun 07 14:52:00.300283 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:52:00.300283 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-e77166e6-a434-44da-bc98-fea44a19e0d1 tempest-VolumesNegativeTest-200339889 tempest-VolumesNegativeTest-200339889-project] Returning 404 to user: Volume 14e43aee-c840-47cb-9668-3bdeea0e08da could not be found. {{(pid=118158) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:52:00.300283 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-e77166e6-a434-44da-bc98-fea44a19e0d1 tempest-VolumesNegativeTest-200339889 tempest-VolumesNegativeTest-200339889-project] 10.222.0.85 "DELETE /compute/v2.1/os-volumes/14e43aee-c840-47cb-9668-3bdeea0e08da" status: 404 len: 109 microversion: 2.1 time: 0.036901 Jun 07 14:52:00.300283 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 565/1120] 10.222.0.85 () {58 vars in 1247 bytes} [Tue Jun 7 14:52:00 2022] DELETE /compute/v2.1/os-volumes/14e43aee-c840-47cb-9668-3bdeea0e08da => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 14:52:00.305623 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-dbe9faa7-0188-421d-a5e3-ebfc90560fea tempest-VolumesNegativeTest-200339889 tempest-VolumesNegativeTest-200339889-project] Calling method '.version_select at 0x7f5f881f95e0>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:52:00.334690 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.wsgi [None req-dbe9faa7-0188-421d-a5e3-ebfc90560fea tempest-VolumesNegativeTest-200339889 tempest-VolumesNegativeTest-200339889-project] HTTP exception thrown: Volume 229c222d-2901-4aa8-9067-2b2cc3acddc9 could not be found. Jun 07 14:52:00.335992 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-dbe9faa7-0188-421d-a5e3-ebfc90560fea tempest-VolumesNegativeTest-200339889 tempest-VolumesNegativeTest-200339889-project] Request method failure captured: Jun 07 14:52:00.335992 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: request: GET /compute/v2.1/os-volumes/229c222d-2901-4aa8-9067-2b2cc3acddc9 HTTP/1.1 Jun 07 14:52:00.335992 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Accept: application/json Jun 07 14:52:00.335992 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Accept-Encoding: identity Jun 07 14:52:00.335992 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Connection: close Jun 07 14:52:00.335992 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Content-Length: 0 Jun 07 14:52:00.335992 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Content-Type: application/json Jun 07 14:52:00.335992 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Host: 10.222.0.85 Jun 07 14:52:00.335992 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Openstack-System-Scope: None Jun 07 14:52:00.335992 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: User-Agent: python-urllib3/1.26.9 Jun 07 14:52:00.335992 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Auth-Token: gAAAAABin2YPwKOueyo-mNOQ8ui9XiX3pjColfvx63KfQV_93uTvHJnUC_rWZwCyCiLpuoLit6o00YBVx8kRb0vIxEs-Fh1JMty6XoVkYRFnA0XuX8vdsjWEaq-B0A6_zjrj2r3udY1DxVQj44-OVvchJB1KX15N4igcIYRMN5arXHd4FNrXV-4 Jun 07 14:52:00.335992 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Domain-Id: None Jun 07 14:52:00.335992 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Domain-Name: None Jun 07 14:52:00.335992 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Identity-Status: Confirmed Jun 07 14:52:00.335992 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Is-Admin-Project: True Jun 07 14:52:00.335992 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Project-Domain-Id: default Jun 07 14:52:00.335992 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Project-Domain-Name: Default Jun 07 14:52:00.335992 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Project-Id: fc7a18c877864f6a91cafd369105bcfa Jun 07 14:52:00.335992 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Project-Name: tempest-VolumesNegativeTest-200339889 Jun 07 14:52:00.335992 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Role: member,reader Jun 07 14:52:00.335992 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Roles: member,reader Jun 07 14:52:00.337701 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/fc7a18c877864f6a91cafd369105bcfa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_fc7a18c877864f6a91cafd369105bcfa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/fc7a18c877864f6a91cafd369105bcfa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/fc7a18c877864f6a91cafd369105bcfa"}]}] Jun 07 14:52:00.337701 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Tenant: tempest-VolumesNegativeTest-200339889 Jun 07 14:52:00.337701 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Tenant-Id: fc7a18c877864f6a91cafd369105bcfa Jun 07 14:52:00.337701 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Tenant-Name: tempest-VolumesNegativeTest-200339889 Jun 07 14:52:00.337701 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User: tempest-VolumesNegativeTest-200339889-project Jun 07 14:52:00.337701 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User-Domain-Id: default Jun 07 14:52:00.337701 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User-Domain-Name: Default Jun 07 14:52:00.337701 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User-Id: be9dec3c8efc4ab580ab02d3fd6b3e4c Jun 07 14:52:00.337701 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User-Name: tempest-VolumesNegativeTest-200339889-project Jun 07 14:52:00.337701 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: method: Jun 07 14:52:00.337701 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: exception: Volume 229c222d-2901-4aa8-9067-2b2cc3acddc9 could not be found. Jun 07 14:52:00.337701 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: action_args: {'id': '229c222d-2901-4aa8-9067-2b2cc3acddc9'} Jun 07 14:52:00.337701 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:52:00.338696 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:52:00.338696 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 14:52:00.338696 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 14:52:00.338696 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 07 14:52:00.338696 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 07 14:52:00.338696 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 07 14:52:00.338696 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 07 14:52:00.338696 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 07 14:52:00.338696 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 07 14:52:00.338696 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 07 14:52:00.338696 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 07 14:52:00.338696 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 14:52:00.338696 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 14:52:00.338696 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 14:52:00.338696 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 14:52:00.338696 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 229c222d-2901-4aa8-9067-2b2cc3acddc9 could not be found. (HTTP 404) (Request-ID: req-8de48010-574a-4f5b-8710-6b9f346d5788) Jun 07 14:52:00.338696 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:52:00.338696 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:52:00.338696 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:52:00.340078 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:52:00.340078 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 07 14:52:00.340078 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 07 14:52:00.340078 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 07 14:52:00.340078 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 07 14:52:00.340078 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 07 14:52:00.340078 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 07 14:52:00.340078 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 07 14:52:00.340078 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 07 14:52:00.340078 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 14:52:00.340078 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 14:52:00.340078 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 07 14:52:00.340078 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 07 14:52:00.340078 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 07 14:52:00.340078 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 07 14:52:00.340078 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 07 14:52:00.340078 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 07 14:52:00.340078 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 07 14:52:00.340078 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 07 14:52:00.342394 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 14:52:00.342394 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 14:52:00.342394 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 14:52:00.342394 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 14:52:00.342394 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 229c222d-2901-4aa8-9067-2b2cc3acddc9 could not be found. Jun 07 14:52:00.342394 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:52:00.342394 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:52:00.342394 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:52:00.342394 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:52:00.342394 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:52:00.342394 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:52:00.342394 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:52:00.342394 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:52:00.342394 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 14:52:00.342394 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 14:52:00.342394 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:52:00.342394 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:52:00.342394 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 07 14:52:00.342394 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:52:00.344881 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 229c222d-2901-4aa8-9067-2b2cc3acddc9 could not be found. Jun 07 14:52:00.344881 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:52:00.344881 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:52:00.344881 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:52:00.344881 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:52:00.344881 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:52:00.344881 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:52:00.344881 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:52:00.344881 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:52:00.344881 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 229c222d-2901-4aa8-9067-2b2cc3acddc9 could not be found. Jun 07 14:52:00.344881 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:52:00.344881 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-dbe9faa7-0188-421d-a5e3-ebfc90560fea tempest-VolumesNegativeTest-200339889 tempest-VolumesNegativeTest-200339889-project] Returning 404 to user: Volume 229c222d-2901-4aa8-9067-2b2cc3acddc9 could not be found. {{(pid=118157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:52:00.344881 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-dbe9faa7-0188-421d-a5e3-ebfc90560fea tempest-VolumesNegativeTest-200339889 tempest-VolumesNegativeTest-200339889-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/229c222d-2901-4aa8-9067-2b2cc3acddc9" status: 404 len: 109 microversion: 2.1 time: 0.035725 Jun 07 14:52:00.344881 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 556/1121] 10.222.0.85 () {58 vars in 1244 bytes} [Tue Jun 7 14:52:00 2022] GET /compute/v2.1/os-volumes/229c222d-2901-4aa8-9067-2b2cc3acddc9 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 14:52:11.819977 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG dbcounter [-] [118158] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=118158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:52:11.820771 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG dbcounter [-] [118158] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:52:11.825525 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-1be1d03b-8106-4612-997e-dedd15f9fbea tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:52:11.826521 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-1be1d03b-8106-4612-997e-dedd15f9fbea tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] [instance: 75e38ceb-ae6e-456f-968b-90e5f4f39d37] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:52:11.833199 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-1be1d03b-8106-4612-997e-dedd15f9fbea tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:52:11.833651 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-1be1d03b-8106-4612-997e-dedd15f9fbea tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:52:11.834424 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-1be1d03b-8106-4612-997e-dedd15f9fbea tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:52:11.834887 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-1be1d03b-8106-4612-997e-dedd15f9fbea tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:52:12.094995 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-1be1d03b-8106-4612-997e-dedd15f9fbea tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] 10.222.0.85 "POST /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37/action" status: 202 len: 0 microversion: 2.1 time: 0.275974 Jun 07 14:52:12.095540 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 566/1122] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Jun 7 14:52:11 2022] POST /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37/action => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 14:52:12.102761 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG dbcounter [-] [118157] Writing DB stats nova_api:SELECT=21,nova_api:DELETE=1 {{(pid=118157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:52:12.103598 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG dbcounter [-] [118157] Writing DB stats nova_cell1:SELECT=46 {{(pid=118157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:52:12.107684 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-fa8a1100-ae72-48a4-9fa3-3424b84bb48a tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:52:12.108405 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-fa8a1100-ae72-48a4-9fa3-3424b84bb48a tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] [instance: 75e38ceb-ae6e-456f-968b-90e5f4f39d37] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:52:12.115434 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-fa8a1100-ae72-48a4-9fa3-3424b84bb48a tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:52:12.115881 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-fa8a1100-ae72-48a4-9fa3-3424b84bb48a tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:52:12.116764 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-fa8a1100-ae72-48a4-9fa3-3424b84bb48a tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:52:12.117191 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-fa8a1100-ae72-48a4-9fa3-3424b84bb48a tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:52:12.266334 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-fa8a1100-ae72-48a4-9fa3-3424b84bb48a tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b3f5c080034b658cbfb311c0c77b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b63567b3e54cf1a4348fb65b65a040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:52:12.274504 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-fa8a1100-ae72-48a4-9fa3-3424b84bb48a tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] 10.222.0.85 "GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37" status: 200 len: 1754 microversion: 2.1 time: 0.174591 Jun 07 14:52:12.275069 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 557/1123] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:52:12 2022] GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37 => generated 1754 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:52:13.293384 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-14437136-d977-475b-9547-3e2572619c2b tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:52:13.296569 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-14437136-d977-475b-9547-3e2572619c2b tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] [instance: 75e38ceb-ae6e-456f-968b-90e5f4f39d37] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:52:13.301736 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-14437136-d977-475b-9547-3e2572619c2b tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:52:13.302197 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-14437136-d977-475b-9547-3e2572619c2b tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:52:13.302968 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-14437136-d977-475b-9547-3e2572619c2b tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:52:13.303412 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-14437136-d977-475b-9547-3e2572619c2b tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:52:13.450245 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-14437136-d977-475b-9547-3e2572619c2b tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b3f5c080034b658cbfb311c0c77b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b63567b3e54cf1a4348fb65b65a040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:52:13.459475 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-14437136-d977-475b-9547-3e2572619c2b tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] 10.222.0.85 "GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37" status: 200 len: 1754 microversion: 2.1 time: 0.170951 Jun 07 14:52:13.469268 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 567/1124] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:52:13 2022] GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37 => generated 1754 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:52:14.477412 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-e4aa407a-b230-4810-b139-34c62b05eda6 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:52:14.478029 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-e4aa407a-b230-4810-b139-34c62b05eda6 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] [instance: 75e38ceb-ae6e-456f-968b-90e5f4f39d37] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:52:14.485489 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-e4aa407a-b230-4810-b139-34c62b05eda6 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:52:14.485931 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-e4aa407a-b230-4810-b139-34c62b05eda6 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:52:14.486695 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-e4aa407a-b230-4810-b139-34c62b05eda6 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:52:14.487131 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-e4aa407a-b230-4810-b139-34c62b05eda6 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:52:14.636332 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-e4aa407a-b230-4810-b139-34c62b05eda6 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b3f5c080034b658cbfb311c0c77b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b63567b3e54cf1a4348fb65b65a040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:52:14.645568 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-e4aa407a-b230-4810-b139-34c62b05eda6 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] 10.222.0.85 "GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37" status: 200 len: 1754 microversion: 2.1 time: 0.172483 Jun 07 14:52:14.646150 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 558/1125] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:52:14 2022] GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37 => generated 1754 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:52:15.663057 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-5e3a0f4f-299a-4b82-99d2-414e0b9dcab1 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:52:15.663612 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-5e3a0f4f-299a-4b82-99d2-414e0b9dcab1 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] [instance: 75e38ceb-ae6e-456f-968b-90e5f4f39d37] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:52:15.670259 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5e3a0f4f-299a-4b82-99d2-414e0b9dcab1 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:52:15.670700 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5e3a0f4f-299a-4b82-99d2-414e0b9dcab1 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:52:15.672086 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5e3a0f4f-299a-4b82-99d2-414e0b9dcab1 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:52:15.672086 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5e3a0f4f-299a-4b82-99d2-414e0b9dcab1 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:52:15.814682 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-5e3a0f4f-299a-4b82-99d2-414e0b9dcab1 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b3f5c080034b658cbfb311c0c77b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b63567b3e54cf1a4348fb65b65a040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:52:15.822700 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-5e3a0f4f-299a-4b82-99d2-414e0b9dcab1 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] 10.222.0.85 "GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37" status: 200 len: 1754 microversion: 2.1 time: 0.163592 Jun 07 14:52:15.823258 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 568/1126] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:52:15 2022] GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37 => generated 1754 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:52:16.840118 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-4dab46d6-c560-40fc-bf02-f3ca619dfe51 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:52:16.840676 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-4dab46d6-c560-40fc-bf02-f3ca619dfe51 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] [instance: 75e38ceb-ae6e-456f-968b-90e5f4f39d37] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:52:16.847704 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-4dab46d6-c560-40fc-bf02-f3ca619dfe51 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:52:16.848154 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-4dab46d6-c560-40fc-bf02-f3ca619dfe51 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:52:16.848947 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-4dab46d6-c560-40fc-bf02-f3ca619dfe51 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:52:16.849379 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-4dab46d6-c560-40fc-bf02-f3ca619dfe51 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:52:16.994251 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-4dab46d6-c560-40fc-bf02-f3ca619dfe51 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b3f5c080034b658cbfb311c0c77b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b63567b3e54cf1a4348fb65b65a040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:52:17.002332 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-4dab46d6-c560-40fc-bf02-f3ca619dfe51 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] 10.222.0.85 "GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37" status: 200 len: 1759 microversion: 2.1 time: 0.166294 Jun 07 14:52:17.002884 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 559/1127] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:52:16 2022] GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37 => generated 1759 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:52:18.019213 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-ff4e4d8e-62c7-49ed-aa78-94bddb6d4956 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:52:18.019831 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-ff4e4d8e-62c7-49ed-aa78-94bddb6d4956 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] [instance: 75e38ceb-ae6e-456f-968b-90e5f4f39d37] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:52:18.025903 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-ff4e4d8e-62c7-49ed-aa78-94bddb6d4956 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:52:18.026358 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-ff4e4d8e-62c7-49ed-aa78-94bddb6d4956 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:52:18.027379 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-ff4e4d8e-62c7-49ed-aa78-94bddb6d4956 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:52:18.027813 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-ff4e4d8e-62c7-49ed-aa78-94bddb6d4956 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:52:18.179562 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-ff4e4d8e-62c7-49ed-aa78-94bddb6d4956 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b3f5c080034b658cbfb311c0c77b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b63567b3e54cf1a4348fb65b65a040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:52:18.189890 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-ff4e4d8e-62c7-49ed-aa78-94bddb6d4956 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] 10.222.0.85 "GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37" status: 200 len: 1759 microversion: 2.1 time: 0.172591 Jun 07 14:52:18.198838 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 569/1128] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:52:18 2022] GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37 => generated 1759 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:52:19.207247 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-05bbe750-c458-486a-af34-dffbf765a6dc tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:52:19.207873 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-05bbe750-c458-486a-af34-dffbf765a6dc tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] [instance: 75e38ceb-ae6e-456f-968b-90e5f4f39d37] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:52:19.215441 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-05bbe750-c458-486a-af34-dffbf765a6dc tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:52:19.216008 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-05bbe750-c458-486a-af34-dffbf765a6dc tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:52:19.217080 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-05bbe750-c458-486a-af34-dffbf765a6dc tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:52:19.217487 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-05bbe750-c458-486a-af34-dffbf765a6dc tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:52:19.377027 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-05bbe750-c458-486a-af34-dffbf765a6dc tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b3f5c080034b658cbfb311c0c77b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b63567b3e54cf1a4348fb65b65a040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:52:19.384992 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-05bbe750-c458-486a-af34-dffbf765a6dc tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] 10.222.0.85 "GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37" status: 200 len: 1759 microversion: 2.1 time: 0.182621 Jun 07 14:52:19.385544 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 560/1129] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:52:19 2022] GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37 => generated 1759 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:52:20.401741 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-ae048e85-ffe8-4841-b0df-ab14e2e40dd4 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:52:20.406504 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-ae048e85-ffe8-4841-b0df-ab14e2e40dd4 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] [instance: 75e38ceb-ae6e-456f-968b-90e5f4f39d37] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:52:20.409173 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-ae048e85-ffe8-4841-b0df-ab14e2e40dd4 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:52:20.409624 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-ae048e85-ffe8-4841-b0df-ab14e2e40dd4 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:52:20.410404 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-ae048e85-ffe8-4841-b0df-ab14e2e40dd4 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:52:20.410825 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-ae048e85-ffe8-4841-b0df-ab14e2e40dd4 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:52:20.576185 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-ae048e85-ffe8-4841-b0df-ab14e2e40dd4 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b3f5c080034b658cbfb311c0c77b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b63567b3e54cf1a4348fb65b65a040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:52:20.584667 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-ae048e85-ffe8-4841-b0df-ab14e2e40dd4 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] 10.222.0.85 "GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37" status: 200 len: 1759 microversion: 2.1 time: 0.186604 Jun 07 14:52:20.587391 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 570/1130] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:52:20 2022] GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37 => generated 1759 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:52:21.601714 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-1cfcc9f3-72c5-43bc-8623-1dd7a632b760 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:52:21.602498 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-1cfcc9f3-72c5-43bc-8623-1dd7a632b760 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] [instance: 75e38ceb-ae6e-456f-968b-90e5f4f39d37] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:52:21.609013 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-1cfcc9f3-72c5-43bc-8623-1dd7a632b760 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:52:21.613696 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-1cfcc9f3-72c5-43bc-8623-1dd7a632b760 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:52:21.613696 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-1cfcc9f3-72c5-43bc-8623-1dd7a632b760 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:52:21.613696 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-1cfcc9f3-72c5-43bc-8623-1dd7a632b760 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:52:21.757873 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-1cfcc9f3-72c5-43bc-8623-1dd7a632b760 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b3f5c080034b658cbfb311c0c77b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b63567b3e54cf1a4348fb65b65a040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:52:21.773058 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-1cfcc9f3-72c5-43bc-8623-1dd7a632b760 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] 10.222.0.85 "GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37" status: 200 len: 1759 microversion: 2.1 time: 0.175150 Jun 07 14:52:21.774188 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 561/1131] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:52:21 2022] GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37 => generated 1759 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:52:22.791779 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-20a8d799-61ee-443c-98ac-6c0d8e992f09 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:52:22.792444 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-20a8d799-61ee-443c-98ac-6c0d8e992f09 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] [instance: 75e38ceb-ae6e-456f-968b-90e5f4f39d37] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:52:22.799060 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-20a8d799-61ee-443c-98ac-6c0d8e992f09 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:52:22.799506 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-20a8d799-61ee-443c-98ac-6c0d8e992f09 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:52:22.800271 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-20a8d799-61ee-443c-98ac-6c0d8e992f09 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:52:22.800742 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-20a8d799-61ee-443c-98ac-6c0d8e992f09 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:52:22.956999 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-20a8d799-61ee-443c-98ac-6c0d8e992f09 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b3f5c080034b658cbfb311c0c77b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b63567b3e54cf1a4348fb65b65a040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:52:22.966553 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-20a8d799-61ee-443c-98ac-6c0d8e992f09 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] 10.222.0.85 "GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37" status: 200 len: 1759 microversion: 2.1 time: 0.178561 Jun 07 14:52:22.967121 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 571/1132] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:52:22 2022] GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37 => generated 1759 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:52:23.982831 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-8be9b715-c44c-4baa-bc15-3ef13e56b3e4 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:52:23.983443 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-8be9b715-c44c-4baa-bc15-3ef13e56b3e4 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] [instance: 75e38ceb-ae6e-456f-968b-90e5f4f39d37] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:52:23.990592 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-8be9b715-c44c-4baa-bc15-3ef13e56b3e4 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:52:23.993618 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-8be9b715-c44c-4baa-bc15-3ef13e56b3e4 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:52:23.993618 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-8be9b715-c44c-4baa-bc15-3ef13e56b3e4 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:52:23.993618 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-8be9b715-c44c-4baa-bc15-3ef13e56b3e4 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:52:24.176605 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-8be9b715-c44c-4baa-bc15-3ef13e56b3e4 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b3f5c080034b658cbfb311c0c77b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b63567b3e54cf1a4348fb65b65a040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:52:24.185065 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-8be9b715-c44c-4baa-bc15-3ef13e56b3e4 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] 10.222.0.85 "GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37" status: 200 len: 1759 microversion: 2.1 time: 0.205992 Jun 07 14:52:24.185592 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 562/1133] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:52:23 2022] GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37 => generated 1759 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:52:25.208216 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-f5cff3e6-ea0a-435e-a744-fb2de8585bc3 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:52:25.208883 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-f5cff3e6-ea0a-435e-a744-fb2de8585bc3 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] [instance: 75e38ceb-ae6e-456f-968b-90e5f4f39d37] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:52:25.215308 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-f5cff3e6-ea0a-435e-a744-fb2de8585bc3 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:52:25.215756 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-f5cff3e6-ea0a-435e-a744-fb2de8585bc3 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:52:25.216681 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-f5cff3e6-ea0a-435e-a744-fb2de8585bc3 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:52:25.217115 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-f5cff3e6-ea0a-435e-a744-fb2de8585bc3 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:52:25.369854 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-f5cff3e6-ea0a-435e-a744-fb2de8585bc3 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b3f5c080034b658cbfb311c0c77b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b63567b3e54cf1a4348fb65b65a040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:52:25.379446 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-f5cff3e6-ea0a-435e-a744-fb2de8585bc3 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] 10.222.0.85 "GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37" status: 200 len: 1759 microversion: 2.1 time: 0.175330 Jun 07 14:52:25.380352 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 572/1134] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:52:25 2022] GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37 => generated 1759 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:52:26.396992 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-9fcca883-c87f-495f-9d8e-8f933e5204de tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:52:26.398233 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-9fcca883-c87f-495f-9d8e-8f933e5204de tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] [instance: 75e38ceb-ae6e-456f-968b-90e5f4f39d37] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:52:26.413864 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-9fcca883-c87f-495f-9d8e-8f933e5204de tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:52:26.414323 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-9fcca883-c87f-495f-9d8e-8f933e5204de tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:52:26.415103 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-9fcca883-c87f-495f-9d8e-8f933e5204de tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:52:26.415716 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-9fcca883-c87f-495f-9d8e-8f933e5204de tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:52:26.590576 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-9fcca883-c87f-495f-9d8e-8f933e5204de tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b3f5c080034b658cbfb311c0c77b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b63567b3e54cf1a4348fb65b65a040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:52:26.598758 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-9fcca883-c87f-495f-9d8e-8f933e5204de tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] 10.222.0.85 "GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37" status: 200 len: 1759 microversion: 2.1 time: 0.205724 Jun 07 14:52:26.599327 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 563/1135] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:52:26 2022] GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37 => generated 1759 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:52:27.617415 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-e6015e7b-dce1-43cb-9d86-1676eac26732 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:52:27.618036 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-e6015e7b-dce1-43cb-9d86-1676eac26732 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] [instance: 75e38ceb-ae6e-456f-968b-90e5f4f39d37] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:52:27.626341 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-e6015e7b-dce1-43cb-9d86-1676eac26732 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:52:27.626879 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-e6015e7b-dce1-43cb-9d86-1676eac26732 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:52:27.627760 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-e6015e7b-dce1-43cb-9d86-1676eac26732 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:52:27.628259 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-e6015e7b-dce1-43cb-9d86-1676eac26732 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:52:27.792740 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-e6015e7b-dce1-43cb-9d86-1676eac26732 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b3f5c080034b658cbfb311c0c77b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b63567b3e54cf1a4348fb65b65a040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:52:27.801693 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-e6015e7b-dce1-43cb-9d86-1676eac26732 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] 10.222.0.85 "GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37" status: 200 len: 1759 microversion: 2.1 time: 0.189679 Jun 07 14:52:27.812142 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 573/1136] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:52:27 2022] GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37 => generated 1759 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:52:28.821883 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-0dd0f8f9-bb2f-40ab-8985-037607b43a42 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:52:28.823157 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-0dd0f8f9-bb2f-40ab-8985-037607b43a42 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] [instance: 75e38ceb-ae6e-456f-968b-90e5f4f39d37] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:52:28.830261 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-0dd0f8f9-bb2f-40ab-8985-037607b43a42 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:52:28.830714 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-0dd0f8f9-bb2f-40ab-8985-037607b43a42 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:52:28.831497 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-0dd0f8f9-bb2f-40ab-8985-037607b43a42 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:52:28.831930 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-0dd0f8f9-bb2f-40ab-8985-037607b43a42 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:52:29.029484 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-0dd0f8f9-bb2f-40ab-8985-037607b43a42 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b3f5c080034b658cbfb311c0c77b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b63567b3e54cf1a4348fb65b65a040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:52:29.037891 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-0dd0f8f9-bb2f-40ab-8985-037607b43a42 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] 10.222.0.85 "GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37" status: 200 len: 1759 microversion: 2.1 time: 0.219786 Jun 07 14:52:29.038821 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 564/1137] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:52:28 2022] GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37 => generated 1759 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:52:30.055138 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-87aefcdb-78f0-4619-9c80-1b8ffeafc1fb tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:52:30.055767 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-87aefcdb-78f0-4619-9c80-1b8ffeafc1fb tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] [instance: 75e38ceb-ae6e-456f-968b-90e5f4f39d37] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:52:30.062372 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-87aefcdb-78f0-4619-9c80-1b8ffeafc1fb tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:52:30.062828 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-87aefcdb-78f0-4619-9c80-1b8ffeafc1fb tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:52:30.063603 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-87aefcdb-78f0-4619-9c80-1b8ffeafc1fb tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:52:30.064076 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-87aefcdb-78f0-4619-9c80-1b8ffeafc1fb tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:52:30.231290 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-87aefcdb-78f0-4619-9c80-1b8ffeafc1fb tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b3f5c080034b658cbfb311c0c77b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b63567b3e54cf1a4348fb65b65a040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:52:30.239926 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-87aefcdb-78f0-4619-9c80-1b8ffeafc1fb tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] 10.222.0.85 "GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37" status: 200 len: 1759 microversion: 2.1 time: 0.188893 Jun 07 14:52:30.240522 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 574/1138] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:52:30 2022] GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37 => generated 1759 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:52:31.257485 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-057738fd-07bd-41bd-ab43-11087a3a1337 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:52:31.258108 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-057738fd-07bd-41bd-ab43-11087a3a1337 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] [instance: 75e38ceb-ae6e-456f-968b-90e5f4f39d37] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:52:31.264740 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-057738fd-07bd-41bd-ab43-11087a3a1337 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:52:31.265215 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-057738fd-07bd-41bd-ab43-11087a3a1337 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:52:31.265971 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-057738fd-07bd-41bd-ab43-11087a3a1337 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:52:31.266408 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-057738fd-07bd-41bd-ab43-11087a3a1337 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:52:31.420411 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-057738fd-07bd-41bd-ab43-11087a3a1337 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b3f5c080034b658cbfb311c0c77b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b63567b3e54cf1a4348fb65b65a040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:52:31.431902 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-057738fd-07bd-41bd-ab43-11087a3a1337 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] 10.222.0.85 "GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37" status: 200 len: 1759 microversion: 2.1 time: 0.175783 Jun 07 14:52:31.431902 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 565/1139] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:52:31 2022] GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37 => generated 1759 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:52:32.447174 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-2057906d-74ee-41bb-ae00-74d3b9ac5b17 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:52:32.447785 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-2057906d-74ee-41bb-ae00-74d3b9ac5b17 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] [instance: 75e38ceb-ae6e-456f-968b-90e5f4f39d37] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:52:32.454433 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-2057906d-74ee-41bb-ae00-74d3b9ac5b17 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:52:32.454779 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-2057906d-74ee-41bb-ae00-74d3b9ac5b17 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:52:32.455536 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-2057906d-74ee-41bb-ae00-74d3b9ac5b17 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:52:32.455968 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-2057906d-74ee-41bb-ae00-74d3b9ac5b17 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:52:32.609091 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-2057906d-74ee-41bb-ae00-74d3b9ac5b17 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b3f5c080034b658cbfb311c0c77b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b63567b3e54cf1a4348fb65b65a040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:52:32.617610 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-2057906d-74ee-41bb-ae00-74d3b9ac5b17 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] 10.222.0.85 "GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37" status: 200 len: 1759 microversion: 2.1 time: 0.174307 Jun 07 14:52:32.618159 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 575/1140] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:52:32 2022] GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37 => generated 1759 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:52:33.388851 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-dbd5560e-c722-4e0b-9bc5-f49e3c8774da tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-193485338", "imageRef": "7802ce25-d370-43a3-8d85-0257d644d539", "flavorRef": "452", "networks": [{"uuid": "d1ee9c1c-9fab-40f5-b36a-a12ac8e09ae8"}]}} {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:52:33.439620 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.network.neutron [None req-dbd5560e-c722-4e0b-9bc5-f49e3c8774da tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] validate_networks() for [('d1ee9c1c-9fab-40f5-b36a-a12ac8e09ae8', None, None, None, None, None)] {{(pid=118157) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 14:52:33.634389 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-5f936f55-d2be-42a6-bb50-343b66704fef tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:52:33.635093 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-5f936f55-d2be-42a6-bb50-343b66704fef tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] [instance: 75e38ceb-ae6e-456f-968b-90e5f4f39d37] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:52:33.641749 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5f936f55-d2be-42a6-bb50-343b66704fef tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:52:33.642287 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5f936f55-d2be-42a6-bb50-343b66704fef tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:52:33.643112 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5f936f55-d2be-42a6-bb50-343b66704fef tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:52:33.643548 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5f936f55-d2be-42a6-bb50-343b66704fef tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:52:33.795123 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.virt.hardware [None req-dbd5560e-c722-4e0b-9bc5-f49e3c8774da tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Flavor limits 0:0:0 {{(pid=118157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 14:52:33.796362 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.virt.hardware [None req-dbd5560e-c722-4e0b-9bc5-f49e3c8774da tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Image limits 0:0:0 {{(pid=118157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 14:52:33.797038 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.virt.hardware [None req-dbd5560e-c722-4e0b-9bc5-f49e3c8774da tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Flavor pref 0:0:0 {{(pid=118157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 14:52:33.797515 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.virt.hardware [None req-dbd5560e-c722-4e0b-9bc5-f49e3c8774da tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Image pref 0:0:0 {{(pid=118157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 14:52:33.797993 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.virt.hardware [None req-dbd5560e-c722-4e0b-9bc5-f49e3c8774da tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 14:52:33.799266 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-5f936f55-d2be-42a6-bb50-343b66704fef tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b3f5c080034b658cbfb311c0c77b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b63567b3e54cf1a4348fb65b65a040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:52:33.807547 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-dbd5560e-c722-4e0b-9bc5-f49e3c8774da tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:52:33.807750 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-5f936f55-d2be-42a6-bb50-343b66704fef tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] 10.222.0.85 "GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37" status: 200 len: 1762 microversion: 2.1 time: 0.177210 Jun 07 14:52:33.808078 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-dbd5560e-c722-4e0b-9bc5-f49e3c8774da tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:52:33.808317 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 576/1141] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:52:33 2022] GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37 => generated 1762 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:52:33.809040 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-dbd5560e-c722-4e0b-9bc5-f49e3c8774da tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:52:33.809541 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-dbd5560e-c722-4e0b-9bc5-f49e3c8774da tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:52:33.827464 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.quota [None req-dbd5560e-c722-4e0b-9bc5-f49e3c8774da tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Getting quotas for project 005732c774f145ffadd2a7bcb3049f26. Resources: {'instances', 'cores', 'ram'} {{(pid=118157) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 14:52:33.831431 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.quota [None req-dbd5560e-c722-4e0b-9bc5-f49e3c8774da tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Getting quotas for user d2228e3ceb4c4f94bf4207ee9a8aac98 and project 005732c774f145ffadd2a7bcb3049f26. Resources: {'instances', 'cores', 'ram'} {{(pid=118157) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 14:52:33.842123 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-dbd5560e-c722-4e0b-9bc5-f49e3c8774da tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Going to run 1 instances... {{(pid=118157) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 14:52:33.844627 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-dbd5560e-c722-4e0b-9bc5-f49e3c8774da tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] [instance: 046929e6-0342-49ba-ab29-d3d8a455e17a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7802ce25-d370-43a3-8d85-0257d644d539',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118157) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 14:52:33.995201 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR oslo.messaging._drivers.impl_rabbit [None req-dbd5560e-c722-4e0b-9bc5-f49e3c8774da tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] [73f7b39e-bd6f-498b-8305-ae22f64f396a] AMQP server on 10.222.0.85:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 07 14:52:35.002726 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO oslo.messaging._drivers.impl_rabbit [None req-dbd5560e-c722-4e0b-9bc5-f49e3c8774da tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] [73f7b39e-bd6f-498b-8305-ae22f64f396a] Reconnected to AMQP server on 10.222.0.85:5672 via [amqp] client with port 36324. Jun 07 14:52:35.007348 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-dbd5560e-c722-4e0b-9bc5-f49e3c8774da tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.622457 Jun 07 14:52:35.008010 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 566/1142] 10.222.0.85 () {60 vars in 1146 bytes} [Tue Jun 7 14:52:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1624 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 14:52:35.017757 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-4a8f3a71-253a-44bc-8e40-bf7f86195631 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:52:35.018374 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-4a8f3a71-253a-44bc-8e40-bf7f86195631 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] [instance: 046929e6-0342-49ba-ab29-d3d8a455e17a] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:52:35.071109 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-4a8f3a71-253a-44bc-8e40-bf7f86195631 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2228e3ceb4c4f94bf4207ee9a8aac98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005732c774f145ffadd2a7bcb3049f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:52:35.079211 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-4a8f3a71-253a-44bc-8e40-bf7f86195631 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] 10.222.0.85 "GET /compute/v2.1/servers/046929e6-0342-49ba-ab29-d3d8a455e17a" status: 200 len: 1213 microversion: 2.1 time: 0.064557 Jun 07 14:52:35.079809 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 577/1143] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:52:35 2022] GET /compute/v2.1/servers/046929e6-0342-49ba-ab29-d3d8a455e17a => generated 1213 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:52:36.097565 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-3f2ed804-de51-4bc7-8e23-13b57fa94f1c tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:52:36.098179 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-3f2ed804-de51-4bc7-8e23-13b57fa94f1c tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] [instance: 046929e6-0342-49ba-ab29-d3d8a455e17a] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:52:36.105009 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-3f2ed804-de51-4bc7-8e23-13b57fa94f1c tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:52:36.105456 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-3f2ed804-de51-4bc7-8e23-13b57fa94f1c tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:52:36.106218 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-3f2ed804-de51-4bc7-8e23-13b57fa94f1c tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:52:36.106663 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-3f2ed804-de51-4bc7-8e23-13b57fa94f1c tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:52:36.167663 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-3f2ed804-de51-4bc7-8e23-13b57fa94f1c tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2228e3ceb4c4f94bf4207ee9a8aac98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005732c774f145ffadd2a7bcb3049f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:52:36.175207 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-3f2ed804-de51-4bc7-8e23-13b57fa94f1c tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] 10.222.0.85 "GET /compute/v2.1/servers/046929e6-0342-49ba-ab29-d3d8a455e17a" status: 200 len: 1217 microversion: 2.1 time: 0.082068 Jun 07 14:52:36.180069 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 567/1144] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:52:36 2022] GET /compute/v2.1/servers/046929e6-0342-49ba-ab29-d3d8a455e17a => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:52:37.192692 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-3786ff21-6487-4f77-9db3-31766f9a36a3 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:52:37.193309 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-3786ff21-6487-4f77-9db3-31766f9a36a3 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] [instance: 046929e6-0342-49ba-ab29-d3d8a455e17a] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:52:37.200694 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-3786ff21-6487-4f77-9db3-31766f9a36a3 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:52:37.201163 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-3786ff21-6487-4f77-9db3-31766f9a36a3 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:52:37.201945 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-3786ff21-6487-4f77-9db3-31766f9a36a3 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:52:37.202368 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-3786ff21-6487-4f77-9db3-31766f9a36a3 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:52:37.279786 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-3786ff21-6487-4f77-9db3-31766f9a36a3 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2228e3ceb4c4f94bf4207ee9a8aac98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005732c774f145ffadd2a7bcb3049f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:52:37.287018 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-3786ff21-6487-4f77-9db3-31766f9a36a3 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] 10.222.0.85 "GET /compute/v2.1/servers/046929e6-0342-49ba-ab29-d3d8a455e17a" status: 200 len: 1273 microversion: 2.1 time: 0.098155 Jun 07 14:52:37.287597 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 578/1145] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:52:37 2022] GET /compute/v2.1/servers/046929e6-0342-49ba-ab29-d3d8a455e17a => generated 1273 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:52:38.304929 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-e6b55791-53e0-4b16-bbe8-a81b3b7b64e0 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:52:38.305544 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-e6b55791-53e0-4b16-bbe8-a81b3b7b64e0 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] [instance: 046929e6-0342-49ba-ab29-d3d8a455e17a] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:52:38.313098 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-e6b55791-53e0-4b16-bbe8-a81b3b7b64e0 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:52:38.313708 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-e6b55791-53e0-4b16-bbe8-a81b3b7b64e0 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:52:38.314513 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-e6b55791-53e0-4b16-bbe8-a81b3b7b64e0 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:52:38.314951 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-e6b55791-53e0-4b16-bbe8-a81b3b7b64e0 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:52:38.476117 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-e6b55791-53e0-4b16-bbe8-a81b3b7b64e0 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2228e3ceb4c4f94bf4207ee9a8aac98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005732c774f145ffadd2a7bcb3049f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:52:38.486092 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-e6b55791-53e0-4b16-bbe8-a81b3b7b64e0 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] 10.222.0.85 "GET /compute/v2.1/servers/046929e6-0342-49ba-ab29-d3d8a455e17a" status: 200 len: 1313 microversion: 2.1 time: 0.185097 Jun 07 14:52:38.487024 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 568/1146] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:52:38 2022] GET /compute/v2.1/servers/046929e6-0342-49ba-ab29-d3d8a455e17a => generated 1313 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:52:39.037863 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [req-ee3a5808-c5bb-4745-b987-f935e0dbe5b5 req-fd9a88c7-4bc6-4052-b6d0-004e88b2dd94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "046929e6-0342-49ba-ab29-d3d8a455e17a", "tag": "990a19da-717d-4bcb-ae18-4bd7ccfdc8cb"}]} {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:52:39.048564 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [req-ee3a5808-c5bb-4745-b987-f935e0dbe5b5 req-fd9a88c7-4bc6-4052-b6d0-004e88b2dd94 service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:52:39.049014 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [req-ee3a5808-c5bb-4745-b987-f935e0dbe5b5 req-fd9a88c7-4bc6-4052-b6d0-004e88b2dd94 service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:52:39.063769 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.compute.server_external_events [req-ee3a5808-c5bb-4745-b987-f935e0dbe5b5 req-fd9a88c7-4bc6-4052-b6d0-004e88b2dd94 service nova] Creating event network-changed:990a19da-717d-4bcb-ae18-4bd7ccfdc8cb for instance 046929e6-0342-49ba-ab29-d3d8a455e17a on hv-cinder-84497 Jun 07 14:52:39.069249 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [req-ee3a5808-c5bb-4745-b987-f935e0dbe5b5 req-fd9a88c7-4bc6-4052-b6d0-004e88b2dd94 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035092 Jun 07 14:52:39.069829 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 579/1147] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jun 7 14:52:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:52:39.506252 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-29bffb35-2f2e-4c8c-a106-32e44fa2feab tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:52:39.506835 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-29bffb35-2f2e-4c8c-a106-32e44fa2feab tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] [instance: 046929e6-0342-49ba-ab29-d3d8a455e17a] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:52:39.512585 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-29bffb35-2f2e-4c8c-a106-32e44fa2feab tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:52:39.513032 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-29bffb35-2f2e-4c8c-a106-32e44fa2feab tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:52:39.513844 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-29bffb35-2f2e-4c8c-a106-32e44fa2feab tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:52:39.514275 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-29bffb35-2f2e-4c8c-a106-32e44fa2feab tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:52:39.646563 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-29bffb35-2f2e-4c8c-a106-32e44fa2feab tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2228e3ceb4c4f94bf4207ee9a8aac98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005732c774f145ffadd2a7bcb3049f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:52:39.654428 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-29bffb35-2f2e-4c8c-a106-32e44fa2feab tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] 10.222.0.85 "GET /compute/v2.1/servers/046929e6-0342-49ba-ab29-d3d8a455e17a" status: 200 len: 1313 microversion: 2.1 time: 0.152800 Jun 07 14:52:39.655004 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 569/1148] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:52:39 2022] GET /compute/v2.1/servers/046929e6-0342-49ba-ab29-d3d8a455e17a => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:52:40.672336 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-324509ff-8d0c-4aab-acfd-4434b3851f47 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:52:40.672974 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-324509ff-8d0c-4aab-acfd-4434b3851f47 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] [instance: 046929e6-0342-49ba-ab29-d3d8a455e17a] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:52:40.680491 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-324509ff-8d0c-4aab-acfd-4434b3851f47 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:52:40.680930 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-324509ff-8d0c-4aab-acfd-4434b3851f47 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:52:40.681684 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-324509ff-8d0c-4aab-acfd-4434b3851f47 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:52:40.682111 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-324509ff-8d0c-4aab-acfd-4434b3851f47 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:52:40.817383 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-324509ff-8d0c-4aab-acfd-4434b3851f47 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2228e3ceb4c4f94bf4207ee9a8aac98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005732c774f145ffadd2a7bcb3049f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:52:40.824830 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-324509ff-8d0c-4aab-acfd-4434b3851f47 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] 10.222.0.85 "GET /compute/v2.1/servers/046929e6-0342-49ba-ab29-d3d8a455e17a" status: 200 len: 1313 microversion: 2.1 time: 0.157297 Jun 07 14:52:40.825384 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 580/1149] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:52:40 2022] GET /compute/v2.1/servers/046929e6-0342-49ba-ab29-d3d8a455e17a => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:52:41.841656 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-99038b99-ea3b-4693-8ef0-1bab61380c14 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:52:41.842280 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-99038b99-ea3b-4693-8ef0-1bab61380c14 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] [instance: 046929e6-0342-49ba-ab29-d3d8a455e17a] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:52:41.849872 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-99038b99-ea3b-4693-8ef0-1bab61380c14 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:52:41.850327 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-99038b99-ea3b-4693-8ef0-1bab61380c14 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:52:41.851093 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-99038b99-ea3b-4693-8ef0-1bab61380c14 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:52:41.851533 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-99038b99-ea3b-4693-8ef0-1bab61380c14 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:52:41.979686 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-99038b99-ea3b-4693-8ef0-1bab61380c14 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2228e3ceb4c4f94bf4207ee9a8aac98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005732c774f145ffadd2a7bcb3049f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:52:41.987761 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-99038b99-ea3b-4693-8ef0-1bab61380c14 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] 10.222.0.85 "GET /compute/v2.1/servers/046929e6-0342-49ba-ab29-d3d8a455e17a" status: 200 len: 1313 microversion: 2.1 time: 0.149629 Jun 07 14:52:41.988790 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 570/1150] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:52:41 2022] GET /compute/v2.1/servers/046929e6-0342-49ba-ab29-d3d8a455e17a => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:52:43.006153 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-f83abf62-27ba-45aa-9c16-f9ad83f7c0bc tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:52:43.006760 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-f83abf62-27ba-45aa-9c16-f9ad83f7c0bc tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] [instance: 046929e6-0342-49ba-ab29-d3d8a455e17a] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:52:43.009165 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG dbcounter [-] [118158] Writing DB stats nova_api:SELECT=33 {{(pid=118158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:52:43.013893 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-f83abf62-27ba-45aa-9c16-f9ad83f7c0bc tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:52:43.014336 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-f83abf62-27ba-45aa-9c16-f9ad83f7c0bc tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:52:43.015090 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-f83abf62-27ba-45aa-9c16-f9ad83f7c0bc tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:52:43.015528 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-f83abf62-27ba-45aa-9c16-f9ad83f7c0bc tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:52:43.151537 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-f83abf62-27ba-45aa-9c16-f9ad83f7c0bc tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2228e3ceb4c4f94bf4207ee9a8aac98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005732c774f145ffadd2a7bcb3049f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:52:43.159450 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-f83abf62-27ba-45aa-9c16-f9ad83f7c0bc tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] 10.222.0.85 "GET /compute/v2.1/servers/046929e6-0342-49ba-ab29-d3d8a455e17a" status: 200 len: 1313 microversion: 2.1 time: 0.157754 Jun 07 14:52:43.160586 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 581/1151] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:52:43 2022] GET /compute/v2.1/servers/046929e6-0342-49ba-ab29-d3d8a455e17a => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:52:44.177681 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-b76a2842-5d33-4837-bd76-8f58bd800bbc tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:52:44.178321 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-b76a2842-5d33-4837-bd76-8f58bd800bbc tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] [instance: 046929e6-0342-49ba-ab29-d3d8a455e17a] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:52:44.180677 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG dbcounter [-] [118157] Writing DB stats nova_cell0:SELECT=2 {{(pid=118157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:52:44.181433 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG dbcounter [-] [118157] Writing DB stats nova_cell0:SELECT=6 {{(pid=118157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:52:44.186407 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-b76a2842-5d33-4837-bd76-8f58bd800bbc tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:52:44.186861 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-b76a2842-5d33-4837-bd76-8f58bd800bbc tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:52:44.187638 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-b76a2842-5d33-4837-bd76-8f58bd800bbc tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:52:44.188081 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-b76a2842-5d33-4837-bd76-8f58bd800bbc tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:52:44.326272 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-b76a2842-5d33-4837-bd76-8f58bd800bbc tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2228e3ceb4c4f94bf4207ee9a8aac98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005732c774f145ffadd2a7bcb3049f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:52:44.333774 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-b76a2842-5d33-4837-bd76-8f58bd800bbc tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] 10.222.0.85 "GET /compute/v2.1/servers/046929e6-0342-49ba-ab29-d3d8a455e17a" status: 200 len: 1313 microversion: 2.1 time: 0.160608 Jun 07 14:52:44.334336 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 571/1152] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:52:44 2022] GET /compute/v2.1/servers/046929e6-0342-49ba-ab29-d3d8a455e17a => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:52:45.351157 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-91cea121-126c-45f3-ad28-f6ac8ddec320 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:52:45.351775 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-91cea121-126c-45f3-ad28-f6ac8ddec320 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] [instance: 046929e6-0342-49ba-ab29-d3d8a455e17a] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:52:45.354222 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG dbcounter [-] [118158] Writing DB stats nova_cell0:SELECT=2 {{(pid=118158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:52:45.359205 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-91cea121-126c-45f3-ad28-f6ac8ddec320 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:52:45.359656 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-91cea121-126c-45f3-ad28-f6ac8ddec320 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:52:45.360459 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-91cea121-126c-45f3-ad28-f6ac8ddec320 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:52:45.360901 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-91cea121-126c-45f3-ad28-f6ac8ddec320 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:52:45.364181 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG dbcounter [-] [118158] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:52:45.505118 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-91cea121-126c-45f3-ad28-f6ac8ddec320 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2228e3ceb4c4f94bf4207ee9a8aac98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005732c774f145ffadd2a7bcb3049f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:52:45.514980 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-91cea121-126c-45f3-ad28-f6ac8ddec320 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] 10.222.0.85 "GET /compute/v2.1/servers/046929e6-0342-49ba-ab29-d3d8a455e17a" status: 200 len: 1313 microversion: 2.1 time: 0.167928 Jun 07 14:52:45.515747 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 582/1153] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:52:45 2022] GET /compute/v2.1/servers/046929e6-0342-49ba-ab29-d3d8a455e17a => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:52:46.540740 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-738ec725-7a40-462d-a63e-311313a4f106 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:52:46.541292 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-738ec725-7a40-462d-a63e-311313a4f106 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] [instance: 046929e6-0342-49ba-ab29-d3d8a455e17a] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:52:46.543594 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG dbcounter [-] [118157] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=118157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:52:46.548705 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-738ec725-7a40-462d-a63e-311313a4f106 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:52:46.549156 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-738ec725-7a40-462d-a63e-311313a4f106 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:52:46.549927 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-738ec725-7a40-462d-a63e-311313a4f106 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:52:46.550872 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-738ec725-7a40-462d-a63e-311313a4f106 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:52:46.554926 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG dbcounter [-] [118157] Writing DB stats nova_cell1:SELECT=87 {{(pid=118157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:52:46.692763 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-738ec725-7a40-462d-a63e-311313a4f106 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2228e3ceb4c4f94bf4207ee9a8aac98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005732c774f145ffadd2a7bcb3049f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:52:46.702151 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-738ec725-7a40-462d-a63e-311313a4f106 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] 10.222.0.85 "GET /compute/v2.1/servers/046929e6-0342-49ba-ab29-d3d8a455e17a" status: 200 len: 1313 microversion: 2.1 time: 0.164948 Jun 07 14:52:46.711557 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 572/1154] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:52:46 2022] GET /compute/v2.1/servers/046929e6-0342-49ba-ab29-d3d8a455e17a => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:52:47.631797 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [req-c7e3f6f0-f098-4e0c-9a41-ba8624c7e44f req-54fdc45a-442b-4e4c-b10c-3f82fc1bfaaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "046929e6-0342-49ba-ab29-d3d8a455e17a", "name": "network-vif-plugged", "status": "completed", "tag": "990a19da-717d-4bcb-ae18-4bd7ccfdc8cb"}]} {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:52:47.640628 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [req-c7e3f6f0-f098-4e0c-9a41-ba8624c7e44f req-54fdc45a-442b-4e4c-b10c-3f82fc1bfaaf service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:52:47.641071 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [req-c7e3f6f0-f098-4e0c-9a41-ba8624c7e44f req-54fdc45a-442b-4e4c-b10c-3f82fc1bfaaf service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:52:47.652473 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.compute.server_external_events [req-c7e3f6f0-f098-4e0c-9a41-ba8624c7e44f req-54fdc45a-442b-4e4c-b10c-3f82fc1bfaaf service nova] Creating event network-vif-plugged:990a19da-717d-4bcb-ae18-4bd7ccfdc8cb for instance 046929e6-0342-49ba-ab29-d3d8a455e17a on hv-cinder-84497 Jun 07 14:52:47.657846 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [req-c7e3f6f0-f098-4e0c-9a41-ba8624c7e44f req-54fdc45a-442b-4e4c-b10c-3f82fc1bfaaf service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030220 Jun 07 14:52:47.658553 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 583/1155] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jun 7 14:52:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:52:47.719843 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-6a6e0985-b559-4ba1-a009-728170ee9b08 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:52:47.720504 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-6a6e0985-b559-4ba1-a009-728170ee9b08 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] [instance: 046929e6-0342-49ba-ab29-d3d8a455e17a] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:52:47.728447 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-6a6e0985-b559-4ba1-a009-728170ee9b08 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:52:47.728937 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-6a6e0985-b559-4ba1-a009-728170ee9b08 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:52:47.730038 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-6a6e0985-b559-4ba1-a009-728170ee9b08 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:52:47.730478 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-6a6e0985-b559-4ba1-a009-728170ee9b08 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:52:47.865914 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-6a6e0985-b559-4ba1-a009-728170ee9b08 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2228e3ceb4c4f94bf4207ee9a8aac98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005732c774f145ffadd2a7bcb3049f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:52:47.873639 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-6a6e0985-b559-4ba1-a009-728170ee9b08 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] 10.222.0.85 "GET /compute/v2.1/servers/046929e6-0342-49ba-ab29-d3d8a455e17a" status: 200 len: 1313 microversion: 2.1 time: 0.158509 Jun 07 14:52:47.874197 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 573/1156] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:52:47 2022] GET /compute/v2.1/servers/046929e6-0342-49ba-ab29-d3d8a455e17a => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:52:48.891839 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-f3cc5f2d-1c17-47b9-8abf-bc1485dfbf27 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:52:48.896805 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-f3cc5f2d-1c17-47b9-8abf-bc1485dfbf27 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] [instance: 046929e6-0342-49ba-ab29-d3d8a455e17a] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:52:48.898745 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-f3cc5f2d-1c17-47b9-8abf-bc1485dfbf27 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:52:48.899197 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-f3cc5f2d-1c17-47b9-8abf-bc1485dfbf27 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:52:48.899967 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-f3cc5f2d-1c17-47b9-8abf-bc1485dfbf27 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:52:48.900433 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-f3cc5f2d-1c17-47b9-8abf-bc1485dfbf27 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:52:49.031928 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-f3cc5f2d-1c17-47b9-8abf-bc1485dfbf27 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2228e3ceb4c4f94bf4207ee9a8aac98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005732c774f145ffadd2a7bcb3049f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:52:49.039917 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-f3cc5f2d-1c17-47b9-8abf-bc1485dfbf27 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] 10.222.0.85 "GET /compute/v2.1/servers/046929e6-0342-49ba-ab29-d3d8a455e17a" status: 200 len: 1313 microversion: 2.1 time: 0.152710 Jun 07 14:52:49.040498 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 584/1157] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:52:48 2022] GET /compute/v2.1/servers/046929e6-0342-49ba-ab29-d3d8a455e17a => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:52:50.057014 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-56340b64-0ab6-40fc-958e-3ad1917e0ac9 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:52:50.057554 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-56340b64-0ab6-40fc-958e-3ad1917e0ac9 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] [instance: 046929e6-0342-49ba-ab29-d3d8a455e17a] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:52:50.064267 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-56340b64-0ab6-40fc-958e-3ad1917e0ac9 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:52:50.064779 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-56340b64-0ab6-40fc-958e-3ad1917e0ac9 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:52:50.065580 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-56340b64-0ab6-40fc-958e-3ad1917e0ac9 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:52:50.066656 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-56340b64-0ab6-40fc-958e-3ad1917e0ac9 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:52:50.200435 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-56340b64-0ab6-40fc-958e-3ad1917e0ac9 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2228e3ceb4c4f94bf4207ee9a8aac98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005732c774f145ffadd2a7bcb3049f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:52:50.207825 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-56340b64-0ab6-40fc-958e-3ad1917e0ac9 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] 10.222.0.85 "GET /compute/v2.1/servers/046929e6-0342-49ba-ab29-d3d8a455e17a" status: 200 len: 1313 microversion: 2.1 time: 0.154886 Jun 07 14:52:50.208397 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 574/1158] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:52:50 2022] GET /compute/v2.1/servers/046929e6-0342-49ba-ab29-d3d8a455e17a => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:52:51.225584 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-1d2a2757-49bc-420b-b683-a07d385cbfb4 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:52:51.226114 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-1d2a2757-49bc-420b-b683-a07d385cbfb4 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] [instance: 046929e6-0342-49ba-ab29-d3d8a455e17a] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:52:51.232774 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-1d2a2757-49bc-420b-b683-a07d385cbfb4 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:52:51.233218 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-1d2a2757-49bc-420b-b683-a07d385cbfb4 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:52:51.233974 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-1d2a2757-49bc-420b-b683-a07d385cbfb4 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:52:51.234407 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-1d2a2757-49bc-420b-b683-a07d385cbfb4 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:52:51.366011 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-1d2a2757-49bc-420b-b683-a07d385cbfb4 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2228e3ceb4c4f94bf4207ee9a8aac98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005732c774f145ffadd2a7bcb3049f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:52:51.373527 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-1d2a2757-49bc-420b-b683-a07d385cbfb4 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] 10.222.0.85 "GET /compute/v2.1/servers/046929e6-0342-49ba-ab29-d3d8a455e17a" status: 200 len: 1497 microversion: 2.1 time: 0.152460 Jun 07 14:52:51.374095 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 585/1159] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:52:51 2022] GET /compute/v2.1/servers/046929e6-0342-49ba-ab29-d3d8a455e17a => generated 1497 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:52:52.327288 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-297b69b9-90ff-4d56-bfa4-be00bfebe14f tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:52:52.327820 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-297b69b9-90ff-4d56-bfa4-be00bfebe14f tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] [instance: 046929e6-0342-49ba-ab29-d3d8a455e17a] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:52:52.335109 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-297b69b9-90ff-4d56-bfa4-be00bfebe14f tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:52:52.335521 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-297b69b9-90ff-4d56-bfa4-be00bfebe14f tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:52:52.336298 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-297b69b9-90ff-4d56-bfa4-be00bfebe14f tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:52:52.336775 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-297b69b9-90ff-4d56-bfa4-be00bfebe14f tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:52:52.363462 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-297b69b9-90ff-4d56-bfa4-be00bfebe14f tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] [instance: 046929e6-0342-49ba-ab29-d3d8a455e17a] Going to try to terminate instance {{(pid=118157) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 14:52:52.603590 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR oslo.messaging._drivers.impl_rabbit [None req-297b69b9-90ff-4d56-bfa4-be00bfebe14f tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] [2a704b59-ae52-4fed-9192-b891e4a3b809] AMQP server on 10.222.0.85:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 07 14:52:53.615726 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO oslo.messaging._drivers.impl_rabbit [None req-297b69b9-90ff-4d56-bfa4-be00bfebe14f tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] [2a704b59-ae52-4fed-9192-b891e4a3b809] Reconnected to AMQP server on 10.222.0.85:5672 via [amqp] client with port 36466. Jun 07 14:52:53.704492 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-297b69b9-90ff-4d56-bfa4-be00bfebe14f tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] 10.222.0.85 "DELETE /compute/v2.1/servers/046929e6-0342-49ba-ab29-d3d8a455e17a" status: 204 len: 0 microversion: 2.1 time: 1.380794 Jun 07 14:52:53.705076 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 575/1160] 10.222.0.85 () {58 vars in 1238 bytes} [Tue Jun 7 14:52:52 2022] DELETE /compute/v2.1/servers/046929e6-0342-49ba-ab29-d3d8a455e17a => generated 0 bytes in 1382 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 14:52:53.713205 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-bf08a2e9-e4a2-4826-a095-9a1f1784166d tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:52:53.713822 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-bf08a2e9-e4a2-4826-a095-9a1f1784166d tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] [instance: 046929e6-0342-49ba-ab29-d3d8a455e17a] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:52:53.720345 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-bf08a2e9-e4a2-4826-a095-9a1f1784166d tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:52:53.720904 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-bf08a2e9-e4a2-4826-a095-9a1f1784166d tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:52:53.721727 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-bf08a2e9-e4a2-4826-a095-9a1f1784166d tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:52:53.722160 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-bf08a2e9-e4a2-4826-a095-9a1f1784166d tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:52:53.858664 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-bf08a2e9-e4a2-4826-a095-9a1f1784166d tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2228e3ceb4c4f94bf4207ee9a8aac98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005732c774f145ffadd2a7bcb3049f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:52:53.867539 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-bf08a2e9-e4a2-4826-a095-9a1f1784166d tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] 10.222.0.85 "GET /compute/v2.1/servers/046929e6-0342-49ba-ab29-d3d8a455e17a" status: 200 len: 1503 microversion: 2.1 time: 0.158139 Jun 07 14:52:53.873273 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 586/1161] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:52:53 2022] GET /compute/v2.1/servers/046929e6-0342-49ba-ab29-d3d8a455e17a => generated 1503 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:52:54.888776 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-9d93abf5-c1ef-4684-ab67-9831d78b8939 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:52:54.889493 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-9d93abf5-c1ef-4684-ab67-9831d78b8939 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] [instance: 046929e6-0342-49ba-ab29-d3d8a455e17a] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:52:54.895704 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-9d93abf5-c1ef-4684-ab67-9831d78b8939 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:52:54.896186 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-9d93abf5-c1ef-4684-ab67-9831d78b8939 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:52:54.896982 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-9d93abf5-c1ef-4684-ab67-9831d78b8939 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:52:54.897421 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-9d93abf5-c1ef-4684-ab67-9831d78b8939 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:52:55.041625 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-9d93abf5-c1ef-4684-ab67-9831d78b8939 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2228e3ceb4c4f94bf4207ee9a8aac98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005732c774f145ffadd2a7bcb3049f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:52:55.049483 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-9d93abf5-c1ef-4684-ab67-9831d78b8939 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] 10.222.0.85 "GET /compute/v2.1/servers/046929e6-0342-49ba-ab29-d3d8a455e17a" status: 200 len: 1503 microversion: 2.1 time: 0.164879 Jun 07 14:52:55.050037 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 576/1162] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:52:54 2022] GET /compute/v2.1/servers/046929e6-0342-49ba-ab29-d3d8a455e17a => generated 1503 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:52:55.912162 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [req-68d2f646-b258-4f13-8b01-9f69c17e49d0 req-7c054f90-d03b-4884-94c8-7988a8b4c734 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "046929e6-0342-49ba-ab29-d3d8a455e17a", "name": "network-vif-deleted", "tag": "990a19da-717d-4bcb-ae18-4bd7ccfdc8cb"}]} {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:52:55.921032 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [req-68d2f646-b258-4f13-8b01-9f69c17e49d0 req-7c054f90-d03b-4884-94c8-7988a8b4c734 service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:52:55.926593 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [req-68d2f646-b258-4f13-8b01-9f69c17e49d0 req-7c054f90-d03b-4884-94c8-7988a8b4c734 service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:52:55.932624 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.compute.server_external_events [req-68d2f646-b258-4f13-8b01-9f69c17e49d0 req-7c054f90-d03b-4884-94c8-7988a8b4c734 service nova] Creating event network-vif-deleted:990a19da-717d-4bcb-ae18-4bd7ccfdc8cb for instance 046929e6-0342-49ba-ab29-d3d8a455e17a on hv-cinder-84497 Jun 07 14:52:55.940492 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [req-68d2f646-b258-4f13-8b01-9f69c17e49d0 req-7c054f90-d03b-4884-94c8-7988a8b4c734 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029484 Jun 07 14:52:55.940492 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 587/1163] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jun 7 14:52:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:52:56.071723 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-6bb0447b-bfbf-46e9-aecb-2d9ee69aaed9 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:52:56.073945 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-6bb0447b-bfbf-46e9-aecb-2d9ee69aaed9 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] [instance: 046929e6-0342-49ba-ab29-d3d8a455e17a] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:52:56.084286 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-6bb0447b-bfbf-46e9-aecb-2d9ee69aaed9 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:52:56.084780 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-6bb0447b-bfbf-46e9-aecb-2d9ee69aaed9 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:52:56.085568 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-6bb0447b-bfbf-46e9-aecb-2d9ee69aaed9 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:52:56.086009 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-6bb0447b-bfbf-46e9-aecb-2d9ee69aaed9 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:52:56.148506 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-6bb0447b-bfbf-46e9-aecb-2d9ee69aaed9 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2228e3ceb4c4f94bf4207ee9a8aac98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005732c774f145ffadd2a7bcb3049f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:52:56.156170 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-6bb0447b-bfbf-46e9-aecb-2d9ee69aaed9 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] 10.222.0.85 "GET /compute/v2.1/servers/046929e6-0342-49ba-ab29-d3d8a455e17a" status: 200 len: 1298 microversion: 2.1 time: 0.092701 Jun 07 14:52:56.156757 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 577/1164] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:52:56 2022] GET /compute/v2.1/servers/046929e6-0342-49ba-ab29-d3d8a455e17a => generated 1298 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:52:57.174284 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-8b78431f-6036-434d-ac39-703aad7ff73c tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:52:57.174992 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-8b78431f-6036-434d-ac39-703aad7ff73c tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] [instance: 046929e6-0342-49ba-ab29-d3d8a455e17a] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:52:57.181951 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-8b78431f-6036-434d-ac39-703aad7ff73c tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:52:57.182405 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-8b78431f-6036-434d-ac39-703aad7ff73c tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:52:57.183172 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-8b78431f-6036-434d-ac39-703aad7ff73c tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:52:57.183607 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-8b78431f-6036-434d-ac39-703aad7ff73c tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:52:57.197923 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.wsgi [None req-8b78431f-6036-434d-ac39-703aad7ff73c tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] HTTP exception thrown: Instance 046929e6-0342-49ba-ab29-d3d8a455e17a could not be found. Jun 07 14:52:57.199708 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-8b78431f-6036-434d-ac39-703aad7ff73c tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Request method failure captured: Jun 07 14:52:57.199708 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: request: GET /compute/v2.1/servers/046929e6-0342-49ba-ab29-d3d8a455e17a HTTP/1.1 Jun 07 14:52:57.199708 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Accept: application/json Jun 07 14:52:57.199708 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Accept-Encoding: identity Jun 07 14:52:57.199708 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Connection: close Jun 07 14:52:57.199708 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Content-Length: 0 Jun 07 14:52:57.199708 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Content-Type: application/json Jun 07 14:52:57.199708 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Host: 10.222.0.85 Jun 07 14:52:57.199708 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Openstack-System-Scope: None Jun 07 14:52:57.199708 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: User-Agent: python-urllib3/1.26.9 Jun 07 14:52:57.199708 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Auth-Token: gAAAAABin2Yu4OmtXHJHi8W-G0UVzvlEfA-Abx6E_7xan_8qlGT6PSK0ZprgIINKvDNNCMNmS6lfJkT5ENrXI7UUGqrtnoEyKNMQv7DAdAfMOQ3MJDn2M7L2KlX5p0CS1MZQRjJGMTNRbHBMQGagZBpTGJdxcZo7TN3Sxnk-wAlsRK3t6qO2v6I Jun 07 14:52:57.199708 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Domain-Id: None Jun 07 14:52:57.199708 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Domain-Name: None Jun 07 14:52:57.199708 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Identity-Status: Confirmed Jun 07 14:52:57.199708 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Is-Admin-Project: True Jun 07 14:52:57.199708 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Domain-Id: default Jun 07 14:52:57.199708 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Domain-Name: Default Jun 07 14:52:57.199708 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Id: 005732c774f145ffadd2a7bcb3049f26 Jun 07 14:52:57.199708 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Name: tempest-VolumesActionsTest-1136474101 Jun 07 14:52:57.199708 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Role: member,reader Jun 07 14:52:57.199708 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Roles: member,reader Jun 07 14:52:57.201557 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/005732c774f145ffadd2a7bcb3049f26"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_005732c774f145ffadd2a7bcb3049f26"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/005732c774f145ffadd2a7bcb3049f26"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/005732c774f145ffadd2a7bcb3049f26"}]}] Jun 07 14:52:57.201557 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Tenant: tempest-VolumesActionsTest-1136474101 Jun 07 14:52:57.201557 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Tenant-Id: 005732c774f145ffadd2a7bcb3049f26 Jun 07 14:52:57.201557 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Tenant-Name: tempest-VolumesActionsTest-1136474101 Jun 07 14:52:57.201557 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User: tempest-VolumesActionsTest-1136474101-project Jun 07 14:52:57.201557 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Domain-Id: default Jun 07 14:52:57.201557 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Domain-Name: Default Jun 07 14:52:57.201557 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Id: d2228e3ceb4c4f94bf4207ee9a8aac98 Jun 07 14:52:57.201557 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Name: tempest-VolumesActionsTest-1136474101-project Jun 07 14:52:57.201557 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: method: > Jun 07 14:52:57.201557 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: exception: Instance 046929e6-0342-49ba-ab29-d3d8a455e17a could not be found. Jun 07 14:52:57.201557 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: action_args: {'id': '046929e6-0342-49ba-ab29-d3d8a455e17a'} Jun 07 14:52:57.202478 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:52:57.202478 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:52:57.202478 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 14:52:57.202478 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 14:52:57.202478 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 14:52:57.202478 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 14:52:57.202478 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 14:52:57.202478 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 14:52:57.202478 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 14:52:57.202478 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 14:52:57.202478 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 046929e6-0342-49ba-ab29-d3d8a455e17a could not be found. Jun 07 14:52:57.202478 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:52:57.202478 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:52:57.202478 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:52:57.202478 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:52:57.202478 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:52:57.202478 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:52:57.202478 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:52:57.202478 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:52:57.202478 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:52:57.204069 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:52:57.204069 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 14:52:57.204069 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 14:52:57.204069 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 14:52:57.204069 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 14:52:57.204069 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 14:52:57.204069 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:52:57.204069 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 046929e6-0342-49ba-ab29-d3d8a455e17a could not be found. Jun 07 14:52:57.204069 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:52:57.204069 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:52:57.204069 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:52:57.204069 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:52:57.204069 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:52:57.204069 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:52:57.204069 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:52:57.204069 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:52:57.204069 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 046929e6-0342-49ba-ab29-d3d8a455e17a could not be found. Jun 07 14:52:57.204069 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:52:57.206027 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-8b78431f-6036-434d-ac39-703aad7ff73c tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Returning 404 to user: Instance 046929e6-0342-49ba-ab29-d3d8a455e17a could not be found. {{(pid=118158) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:52:57.206027 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-8b78431f-6036-434d-ac39-703aad7ff73c tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] 10.222.0.85 "GET /compute/v2.1/servers/046929e6-0342-49ba-ab29-d3d8a455e17a" status: 404 len: 111 microversion: 2.1 time: 0.031575 Jun 07 14:52:57.206027 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 588/1165] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:52:57 2022] GET /compute/v2.1/servers/046929e6-0342-49ba-ab29-d3d8a455e17a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 14:52:57.317305 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-57dc32a2-a0c7-4d9d-ac38-1396ef23e883 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-382889248", "imageRef": "7802ce25-d370-43a3-8d85-0257d644d539", "flavorRef": "452", "networks": [{"uuid": "d1ee9c1c-9fab-40f5-b36a-a12ac8e09ae8"}]}} {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:52:57.389744 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.network.neutron [None req-57dc32a2-a0c7-4d9d-ac38-1396ef23e883 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] validate_networks() for [('d1ee9c1c-9fab-40f5-b36a-a12ac8e09ae8', None, None, None, None, None)] {{(pid=118157) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 14:52:58.035939 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.virt.hardware [None req-57dc32a2-a0c7-4d9d-ac38-1396ef23e883 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Flavor limits 0:0:0 {{(pid=118157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 14:52:58.036762 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.virt.hardware [None req-57dc32a2-a0c7-4d9d-ac38-1396ef23e883 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Image limits 0:0:0 {{(pid=118157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 14:52:58.037456 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.virt.hardware [None req-57dc32a2-a0c7-4d9d-ac38-1396ef23e883 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Flavor pref 0:0:0 {{(pid=118157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 14:52:58.037954 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.virt.hardware [None req-57dc32a2-a0c7-4d9d-ac38-1396ef23e883 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Image pref 0:0:0 {{(pid=118157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 14:52:58.038438 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.virt.hardware [None req-57dc32a2-a0c7-4d9d-ac38-1396ef23e883 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 14:52:58.048193 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-57dc32a2-a0c7-4d9d-ac38-1396ef23e883 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:52:58.048766 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-57dc32a2-a0c7-4d9d-ac38-1396ef23e883 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:52:58.049634 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-57dc32a2-a0c7-4d9d-ac38-1396ef23e883 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:52:58.050135 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-57dc32a2-a0c7-4d9d-ac38-1396ef23e883 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:52:58.069550 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.quota [None req-57dc32a2-a0c7-4d9d-ac38-1396ef23e883 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Getting quotas for project 005732c774f145ffadd2a7bcb3049f26. Resources: {'instances', 'cores', 'ram'} {{(pid=118157) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 14:52:58.073773 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.quota [None req-57dc32a2-a0c7-4d9d-ac38-1396ef23e883 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Getting quotas for user d2228e3ceb4c4f94bf4207ee9a8aac98 and project 005732c774f145ffadd2a7bcb3049f26. Resources: {'instances', 'cores', 'ram'} {{(pid=118157) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 14:52:58.087409 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-57dc32a2-a0c7-4d9d-ac38-1396ef23e883 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Going to run 1 instances... {{(pid=118157) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 14:52:58.089713 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-57dc32a2-a0c7-4d9d-ac38-1396ef23e883 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] [instance: 131b0b42-3011-4322-a842-a34ab7466c51] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7802ce25-d370-43a3-8d85-0257d644d539',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118157) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 14:52:58.227199 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-57dc32a2-a0c7-4d9d-ac38-1396ef23e883 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.919958 Jun 07 14:52:58.228229 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 578/1166] 10.222.0.85 () {60 vars in 1146 bytes} [Tue Jun 7 14:52:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 922 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 14:52:58.257114 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-efcc6ed9-a816-412c-9a3f-4b963207ee7f tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:52:58.257114 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-efcc6ed9-a816-412c-9a3f-4b963207ee7f tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] [instance: 131b0b42-3011-4322-a842-a34ab7466c51] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:52:58.313310 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-efcc6ed9-a816-412c-9a3f-4b963207ee7f tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2228e3ceb4c4f94bf4207ee9a8aac98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005732c774f145ffadd2a7bcb3049f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:52:58.339092 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-efcc6ed9-a816-412c-9a3f-4b963207ee7f tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] 10.222.0.85 "GET /compute/v2.1/servers/131b0b42-3011-4322-a842-a34ab7466c51" status: 200 len: 1213 microversion: 2.1 time: 0.103955 Jun 07 14:52:58.340189 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 589/1167] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:52:58 2022] GET /compute/v2.1/servers/131b0b42-3011-4322-a842-a34ab7466c51 => generated 1213 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:52:59.357500 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-18bb7665-4577-40e9-acfc-16a1877ad8e7 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:52:59.358775 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-18bb7665-4577-40e9-acfc-16a1877ad8e7 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] [instance: 131b0b42-3011-4322-a842-a34ab7466c51] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:52:59.367536 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-18bb7665-4577-40e9-acfc-16a1877ad8e7 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:52:59.368234 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-18bb7665-4577-40e9-acfc-16a1877ad8e7 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:52:59.369255 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-18bb7665-4577-40e9-acfc-16a1877ad8e7 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:52:59.369699 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-18bb7665-4577-40e9-acfc-16a1877ad8e7 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:52:59.465624 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-18bb7665-4577-40e9-acfc-16a1877ad8e7 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2228e3ceb4c4f94bf4207ee9a8aac98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005732c774f145ffadd2a7bcb3049f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:52:59.475180 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-18bb7665-4577-40e9-acfc-16a1877ad8e7 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] 10.222.0.85 "GET /compute/v2.1/servers/131b0b42-3011-4322-a842-a34ab7466c51" status: 200 len: 1217 microversion: 2.1 time: 0.121400 Jun 07 14:52:59.484877 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 579/1168] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:52:59 2022] GET /compute/v2.1/servers/131b0b42-3011-4322-a842-a34ab7466c51 => generated 1217 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:53:00.492545 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-70b33d8d-4e86-41e5-a53b-12c3f98d0d9f tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:53:00.493157 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-70b33d8d-4e86-41e5-a53b-12c3f98d0d9f tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] [instance: 131b0b42-3011-4322-a842-a34ab7466c51] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:53:00.508225 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-70b33d8d-4e86-41e5-a53b-12c3f98d0d9f tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:00.508908 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-70b33d8d-4e86-41e5-a53b-12c3f98d0d9f tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:00.511529 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-70b33d8d-4e86-41e5-a53b-12c3f98d0d9f tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:00.512170 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-70b33d8d-4e86-41e5-a53b-12c3f98d0d9f tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:00.648468 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-70b33d8d-4e86-41e5-a53b-12c3f98d0d9f tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2228e3ceb4c4f94bf4207ee9a8aac98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005732c774f145ffadd2a7bcb3049f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:53:00.657271 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-70b33d8d-4e86-41e5-a53b-12c3f98d0d9f tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] 10.222.0.85 "GET /compute/v2.1/servers/131b0b42-3011-4322-a842-a34ab7466c51" status: 200 len: 1273 microversion: 2.1 time: 0.168456 Jun 07 14:53:00.658182 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 590/1169] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:53:00 2022] GET /compute/v2.1/servers/131b0b42-3011-4322-a842-a34ab7466c51 => generated 1273 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:53:01.687489 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-7b12cb19-a8ca-4286-be1d-92396d68c480 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:53:01.687489 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-7b12cb19-a8ca-4286-be1d-92396d68c480 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] [instance: 131b0b42-3011-4322-a842-a34ab7466c51] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:53:01.692920 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-7b12cb19-a8ca-4286-be1d-92396d68c480 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:01.693979 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-7b12cb19-a8ca-4286-be1d-92396d68c480 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:01.694773 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-7b12cb19-a8ca-4286-be1d-92396d68c480 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:01.695242 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-7b12cb19-a8ca-4286-be1d-92396d68c480 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:01.842953 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-7b12cb19-a8ca-4286-be1d-92396d68c480 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2228e3ceb4c4f94bf4207ee9a8aac98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005732c774f145ffadd2a7bcb3049f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:53:01.851329 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-7b12cb19-a8ca-4286-be1d-92396d68c480 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] 10.222.0.85 "GET /compute/v2.1/servers/131b0b42-3011-4322-a842-a34ab7466c51" status: 200 len: 1313 microversion: 2.1 time: 0.179080 Jun 07 14:53:01.852596 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 580/1170] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:53:01 2022] GET /compute/v2.1/servers/131b0b42-3011-4322-a842-a34ab7466c51 => generated 1313 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:53:02.685734 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [req-b3707e98-6728-4d2a-8594-3ebd22be6c01 req-dacfdeea-5b25-4b38-8cbf-a7fa0985fd29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "131b0b42-3011-4322-a842-a34ab7466c51", "tag": "c746e397-360d-4b33-88ed-d2bab7f6c22c"}]} {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:53:02.697125 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [req-b3707e98-6728-4d2a-8594-3ebd22be6c01 req-dacfdeea-5b25-4b38-8cbf-a7fa0985fd29 service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:02.697558 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [req-b3707e98-6728-4d2a-8594-3ebd22be6c01 req-dacfdeea-5b25-4b38-8cbf-a7fa0985fd29 service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:02.710046 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.compute.server_external_events [req-b3707e98-6728-4d2a-8594-3ebd22be6c01 req-dacfdeea-5b25-4b38-8cbf-a7fa0985fd29 service nova] Creating event network-changed:c746e397-360d-4b33-88ed-d2bab7f6c22c for instance 131b0b42-3011-4322-a842-a34ab7466c51 on hv-cinder-84497 Jun 07 14:53:02.714807 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [req-b3707e98-6728-4d2a-8594-3ebd22be6c01 req-dacfdeea-5b25-4b38-8cbf-a7fa0985fd29 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033904 Jun 07 14:53:02.722750 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 591/1171] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jun 7 14:53:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:53:02.875032 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-862cdb52-2a8c-43e4-88bd-7cc48b84499e tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:53:02.875649 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-862cdb52-2a8c-43e4-88bd-7cc48b84499e tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] [instance: 131b0b42-3011-4322-a842-a34ab7466c51] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:53:02.883101 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-862cdb52-2a8c-43e4-88bd-7cc48b84499e tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:02.883550 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-862cdb52-2a8c-43e4-88bd-7cc48b84499e tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:02.884321 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-862cdb52-2a8c-43e4-88bd-7cc48b84499e tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:02.884780 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-862cdb52-2a8c-43e4-88bd-7cc48b84499e tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:03.109358 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-862cdb52-2a8c-43e4-88bd-7cc48b84499e tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2228e3ceb4c4f94bf4207ee9a8aac98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005732c774f145ffadd2a7bcb3049f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:53:03.122572 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-862cdb52-2a8c-43e4-88bd-7cc48b84499e tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] 10.222.0.85 "GET /compute/v2.1/servers/131b0b42-3011-4322-a842-a34ab7466c51" status: 200 len: 1313 microversion: 2.1 time: 0.251242 Jun 07 14:53:03.124535 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 581/1172] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:53:02 2022] GET /compute/v2.1/servers/131b0b42-3011-4322-a842-a34ab7466c51 => generated 1313 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:53:04.143466 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-f8b2e16e-69d5-4796-8387-886e1dc97399 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:53:04.144451 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-f8b2e16e-69d5-4796-8387-886e1dc97399 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] [instance: 131b0b42-3011-4322-a842-a34ab7466c51] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:53:04.158648 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-f8b2e16e-69d5-4796-8387-886e1dc97399 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:04.159149 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-f8b2e16e-69d5-4796-8387-886e1dc97399 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:04.159969 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-f8b2e16e-69d5-4796-8387-886e1dc97399 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:04.160431 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-f8b2e16e-69d5-4796-8387-886e1dc97399 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:04.366331 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-f8b2e16e-69d5-4796-8387-886e1dc97399 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2228e3ceb4c4f94bf4207ee9a8aac98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005732c774f145ffadd2a7bcb3049f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:53:04.374739 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-f8b2e16e-69d5-4796-8387-886e1dc97399 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] 10.222.0.85 "GET /compute/v2.1/servers/131b0b42-3011-4322-a842-a34ab7466c51" status: 200 len: 1313 microversion: 2.1 time: 0.238331 Jun 07 14:53:04.376060 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 592/1173] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:53:04 2022] GET /compute/v2.1/servers/131b0b42-3011-4322-a842-a34ab7466c51 => generated 1313 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:53:05.397061 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-9e5b64e7-286c-4ce5-b5bd-18ef802881d4 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:53:05.397061 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-9e5b64e7-286c-4ce5-b5bd-18ef802881d4 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] [instance: 131b0b42-3011-4322-a842-a34ab7466c51] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:53:05.401407 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-9e5b64e7-286c-4ce5-b5bd-18ef802881d4 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:05.401847 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-9e5b64e7-286c-4ce5-b5bd-18ef802881d4 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:05.403063 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-9e5b64e7-286c-4ce5-b5bd-18ef802881d4 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:05.403660 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-9e5b64e7-286c-4ce5-b5bd-18ef802881d4 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:05.632507 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-9e5b64e7-286c-4ce5-b5bd-18ef802881d4 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2228e3ceb4c4f94bf4207ee9a8aac98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005732c774f145ffadd2a7bcb3049f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:53:05.641208 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-9e5b64e7-286c-4ce5-b5bd-18ef802881d4 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] 10.222.0.85 "GET /compute/v2.1/servers/131b0b42-3011-4322-a842-a34ab7466c51" status: 200 len: 1313 microversion: 2.1 time: 0.251547 Jun 07 14:53:05.642258 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 582/1174] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:53:05 2022] GET /compute/v2.1/servers/131b0b42-3011-4322-a842-a34ab7466c51 => generated 1313 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:53:06.664248 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-e865b04e-ab9b-4ab3-b531-3a971c30d317 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:53:06.665639 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-e865b04e-ab9b-4ab3-b531-3a971c30d317 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] [instance: 131b0b42-3011-4322-a842-a34ab7466c51] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:53:06.672311 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-e865b04e-ab9b-4ab3-b531-3a971c30d317 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:06.672940 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-e865b04e-ab9b-4ab3-b531-3a971c30d317 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:06.678026 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-e865b04e-ab9b-4ab3-b531-3a971c30d317 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:06.678026 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-e865b04e-ab9b-4ab3-b531-3a971c30d317 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:06.819523 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-e865b04e-ab9b-4ab3-b531-3a971c30d317 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2228e3ceb4c4f94bf4207ee9a8aac98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005732c774f145ffadd2a7bcb3049f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:53:06.828490 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-e865b04e-ab9b-4ab3-b531-3a971c30d317 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] 10.222.0.85 "GET /compute/v2.1/servers/131b0b42-3011-4322-a842-a34ab7466c51" status: 200 len: 1313 microversion: 2.1 time: 0.173267 Jun 07 14:53:06.839867 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 593/1175] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:53:06 2022] GET /compute/v2.1/servers/131b0b42-3011-4322-a842-a34ab7466c51 => generated 1313 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:53:07.850145 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-990d10e0-77d5-42c2-9515-0f9f3318d354 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:53:07.850145 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-990d10e0-77d5-42c2-9515-0f9f3318d354 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] [instance: 131b0b42-3011-4322-a842-a34ab7466c51] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:53:07.857543 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-990d10e0-77d5-42c2-9515-0f9f3318d354 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:07.858090 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-990d10e0-77d5-42c2-9515-0f9f3318d354 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:07.858953 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-990d10e0-77d5-42c2-9515-0f9f3318d354 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:07.859575 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-990d10e0-77d5-42c2-9515-0f9f3318d354 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:08.058455 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG dbcounter [-] [118157] Writing DB stats nova_cell0:SELECT=2 {{(pid=118157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:53:08.082523 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG dbcounter [-] [118157] Writing DB stats nova_cell0:SELECT=6 {{(pid=118157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:53:08.093254 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-990d10e0-77d5-42c2-9515-0f9f3318d354 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2228e3ceb4c4f94bf4207ee9a8aac98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005732c774f145ffadd2a7bcb3049f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:53:08.107113 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-990d10e0-77d5-42c2-9515-0f9f3318d354 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] 10.222.0.85 "GET /compute/v2.1/servers/131b0b42-3011-4322-a842-a34ab7466c51" status: 200 len: 1313 microversion: 2.1 time: 0.262724 Jun 07 14:53:08.109755 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 583/1176] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:53:07 2022] GET /compute/v2.1/servers/131b0b42-3011-4322-a842-a34ab7466c51 => generated 1313 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:53:08.327715 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG dbcounter [-] [118158] Writing DB stats nova_cell0:SELECT=2 {{(pid=118158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:53:08.532221 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-9316bbd1-c03f-4495-8336-77caed73e177 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Action: 'create', calling method: .version_select at 0x7f5f8c122a60>, body: {"keypair": {"name": "tempest-TestShelveInstance-492376855", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLrRLqhvOc2/ea9UDXcfYgx0RKb6yqdi9JqmSMS97i6DoNW/eECGwcdWA+0RjPGXwSlEdF7xbHKGAaO9PCCCG6GftDgoo9MkFdnIJjxSge09/0nK0mfiPPgl86weyFyFbQ=="}} {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:53:08.550019 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.quota [None req-9316bbd1-c03f-4495-8336-77caed73e177 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Getting quotas for project deac7502c4684bdcb5dd9151d6c09894. Resources: {'key_pairs'} {{(pid=118158) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 14:53:08.554781 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.quota [None req-9316bbd1-c03f-4495-8336-77caed73e177 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Getting quotas for user 9e7e40e0dfbf49a58d67b897f4792399 and project deac7502c4684bdcb5dd9151d6c09894. Resources: {'key_pairs'} {{(pid=118158) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 14:53:08.654630 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-9316bbd1-c03f-4495-8336-77caed73e177 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.389653 Jun 07 14:53:08.655570 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 594/1177] 10.222.0.85 () {60 vars in 1158 bytes} [Tue Jun 7 14:53:08 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:53:09.127441 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-9c24795a-6754-47f2-8e57-28f9d526457a tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:53:09.127975 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-9c24795a-6754-47f2-8e57-28f9d526457a tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] [instance: 131b0b42-3011-4322-a842-a34ab7466c51] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:53:09.134894 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-9c24795a-6754-47f2-8e57-28f9d526457a tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:09.135348 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-9c24795a-6754-47f2-8e57-28f9d526457a tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:09.136125 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-9c24795a-6754-47f2-8e57-28f9d526457a tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:09.136631 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-9c24795a-6754-47f2-8e57-28f9d526457a tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:09.330826 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-9c24795a-6754-47f2-8e57-28f9d526457a tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2228e3ceb4c4f94bf4207ee9a8aac98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005732c774f145ffadd2a7bcb3049f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:53:09.339700 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-9c24795a-6754-47f2-8e57-28f9d526457a tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] 10.222.0.85 "GET /compute/v2.1/servers/131b0b42-3011-4322-a842-a34ab7466c51" status: 200 len: 1313 microversion: 2.1 time: 0.217058 Jun 07 14:53:09.340359 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 584/1178] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:53:09 2022] GET /compute/v2.1/servers/131b0b42-3011-4322-a842-a34ab7466c51 => generated 1313 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:53:09.763653 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [req-ad65723e-3259-4f55-8282-307b398a46d4 req-c44403e4-d625-4e36-becf-ea3773fd718a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "131b0b42-3011-4322-a842-a34ab7466c51", "name": "network-vif-plugged", "status": "completed", "tag": "c746e397-360d-4b33-88ed-d2bab7f6c22c"}]} {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:53:09.773176 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [req-ad65723e-3259-4f55-8282-307b398a46d4 req-c44403e4-d625-4e36-becf-ea3773fd718a service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:09.773731 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [req-ad65723e-3259-4f55-8282-307b398a46d4 req-c44403e4-d625-4e36-becf-ea3773fd718a service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:09.784660 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.compute.server_external_events [req-ad65723e-3259-4f55-8282-307b398a46d4 req-c44403e4-d625-4e36-becf-ea3773fd718a service nova] Creating event network-vif-plugged:c746e397-360d-4b33-88ed-d2bab7f6c22c for instance 131b0b42-3011-4322-a842-a34ab7466c51 on hv-cinder-84497 Jun 07 14:53:09.789616 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [req-ad65723e-3259-4f55-8282-307b398a46d4 req-c44403e4-d625-4e36-becf-ea3773fd718a service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030688 Jun 07 14:53:09.790153 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 595/1179] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jun 7 14:53:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:53:10.356981 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-68f3a2b5-46d4-4489-a138-f462a654d479 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:53:10.357699 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-68f3a2b5-46d4-4489-a138-f462a654d479 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] [instance: 131b0b42-3011-4322-a842-a34ab7466c51] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:53:10.363900 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-68f3a2b5-46d4-4489-a138-f462a654d479 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:10.364346 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-68f3a2b5-46d4-4489-a138-f462a654d479 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:10.365135 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-68f3a2b5-46d4-4489-a138-f462a654d479 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:10.365564 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-68f3a2b5-46d4-4489-a138-f462a654d479 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:10.523073 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-68f3a2b5-46d4-4489-a138-f462a654d479 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2228e3ceb4c4f94bf4207ee9a8aac98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005732c774f145ffadd2a7bcb3049f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:53:10.531066 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-68f3a2b5-46d4-4489-a138-f462a654d479 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] 10.222.0.85 "GET /compute/v2.1/servers/131b0b42-3011-4322-a842-a34ab7466c51" status: 200 len: 1313 microversion: 2.1 time: 0.177836 Jun 07 14:53:10.531652 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 585/1180] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:53:10 2022] GET /compute/v2.1/servers/131b0b42-3011-4322-a842-a34ab7466c51 => generated 1313 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:53:11.550433 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-b7f8c14f-93bf-42ab-ab70-7a0bd5e40461 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:53:11.551047 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-b7f8c14f-93bf-42ab-ab70-7a0bd5e40461 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] [instance: 131b0b42-3011-4322-a842-a34ab7466c51] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:53:11.558097 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-b7f8c14f-93bf-42ab-ab70-7a0bd5e40461 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:11.558547 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-b7f8c14f-93bf-42ab-ab70-7a0bd5e40461 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:11.559310 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-b7f8c14f-93bf-42ab-ab70-7a0bd5e40461 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:11.559738 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-b7f8c14f-93bf-42ab-ab70-7a0bd5e40461 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:11.717295 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-b7f8c14f-93bf-42ab-ab70-7a0bd5e40461 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2228e3ceb4c4f94bf4207ee9a8aac98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005732c774f145ffadd2a7bcb3049f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:53:11.725559 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-b7f8c14f-93bf-42ab-ab70-7a0bd5e40461 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] 10.222.0.85 "GET /compute/v2.1/servers/131b0b42-3011-4322-a842-a34ab7466c51" status: 200 len: 1313 microversion: 2.1 time: 0.180179 Jun 07 14:53:11.726692 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 596/1181] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:53:11 2022] GET /compute/v2.1/servers/131b0b42-3011-4322-a842-a34ab7466c51 => generated 1313 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:53:12.743178 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-5bb61682-3793-4185-9c86-5737aebad8a3 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:53:12.743808 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-5bb61682-3793-4185-9c86-5737aebad8a3 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] [instance: 131b0b42-3011-4322-a842-a34ab7466c51] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:53:12.751000 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-5bb61682-3793-4185-9c86-5737aebad8a3 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:12.751576 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-5bb61682-3793-4185-9c86-5737aebad8a3 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:12.752529 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-5bb61682-3793-4185-9c86-5737aebad8a3 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:12.753140 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-5bb61682-3793-4185-9c86-5737aebad8a3 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:12.916546 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-5bb61682-3793-4185-9c86-5737aebad8a3 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2228e3ceb4c4f94bf4207ee9a8aac98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005732c774f145ffadd2a7bcb3049f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:53:12.935240 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-5bb61682-3793-4185-9c86-5737aebad8a3 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] 10.222.0.85 "GET /compute/v2.1/servers/131b0b42-3011-4322-a842-a34ab7466c51" status: 200 len: 1497 microversion: 2.1 time: 0.196348 Jun 07 14:53:12.936107 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 586/1182] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:53:12 2022] GET /compute/v2.1/servers/131b0b42-3011-4322-a842-a34ab7466c51 => generated 1497 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:53:13.939985 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-b2ee2987-1468-44d3-bea5-602a26c5583d tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:53:13.940529 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-b2ee2987-1468-44d3-bea5-602a26c5583d tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] [instance: 131b0b42-3011-4322-a842-a34ab7466c51] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:53:13.943354 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG dbcounter [-] [118158] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=118158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:53:13.948222 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-b2ee2987-1468-44d3-bea5-602a26c5583d tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:13.948706 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-b2ee2987-1468-44d3-bea5-602a26c5583d tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:13.949497 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-b2ee2987-1468-44d3-bea5-602a26c5583d tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:13.949936 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-b2ee2987-1468-44d3-bea5-602a26c5583d tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:13.976180 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-b2ee2987-1468-44d3-bea5-602a26c5583d tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] [instance: 131b0b42-3011-4322-a842-a34ab7466c51] Going to try to terminate instance {{(pid=118158) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 14:53:14.289231 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-b2ee2987-1468-44d3-bea5-602a26c5583d tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] 10.222.0.85 "DELETE /compute/v2.1/servers/131b0b42-3011-4322-a842-a34ab7466c51" status: 204 len: 0 microversion: 2.1 time: 0.352842 Jun 07 14:53:14.289888 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 597/1183] 10.222.0.85 () {58 vars in 1238 bytes} [Tue Jun 7 14:53:13 2022] DELETE /compute/v2.1/servers/131b0b42-3011-4322-a842-a34ab7466c51 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 14:53:14.298189 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-09fe40fa-2cac-415a-b7f5-bcf41c33c765 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:53:14.299209 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-09fe40fa-2cac-415a-b7f5-bcf41c33c765 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] [instance: 131b0b42-3011-4322-a842-a34ab7466c51] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:53:14.308804 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-09fe40fa-2cac-415a-b7f5-bcf41c33c765 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:14.309893 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-09fe40fa-2cac-415a-b7f5-bcf41c33c765 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:14.311177 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-09fe40fa-2cac-415a-b7f5-bcf41c33c765 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:14.311881 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-09fe40fa-2cac-415a-b7f5-bcf41c33c765 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:14.485304 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-09fe40fa-2cac-415a-b7f5-bcf41c33c765 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2228e3ceb4c4f94bf4207ee9a8aac98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005732c774f145ffadd2a7bcb3049f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:53:14.489331 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG dbcounter [-] [118157] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:53:14.495534 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-09fe40fa-2cac-415a-b7f5-bcf41c33c765 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] 10.222.0.85 "GET /compute/v2.1/servers/131b0b42-3011-4322-a842-a34ab7466c51" status: 200 len: 1503 microversion: 2.1 time: 0.201268 Jun 07 14:53:14.496133 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 587/1184] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:53:14 2022] GET /compute/v2.1/servers/131b0b42-3011-4322-a842-a34ab7466c51 => generated 1503 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:53:15.519417 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-b5de5515-e7d4-4ed0-8ea7-0ecf2303d99a tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:53:15.531263 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-b5de5515-e7d4-4ed0-8ea7-0ecf2303d99a tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] [instance: 131b0b42-3011-4322-a842-a34ab7466c51] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:53:15.531263 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-b5de5515-e7d4-4ed0-8ea7-0ecf2303d99a tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:15.531263 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-b5de5515-e7d4-4ed0-8ea7-0ecf2303d99a tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:15.531263 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-b5de5515-e7d4-4ed0-8ea7-0ecf2303d99a tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:15.531777 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-b5de5515-e7d4-4ed0-8ea7-0ecf2303d99a tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:15.659036 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-b5de5515-e7d4-4ed0-8ea7-0ecf2303d99a tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2228e3ceb4c4f94bf4207ee9a8aac98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005732c774f145ffadd2a7bcb3049f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:53:15.667604 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-b5de5515-e7d4-4ed0-8ea7-0ecf2303d99a tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] 10.222.0.85 "GET /compute/v2.1/servers/131b0b42-3011-4322-a842-a34ab7466c51" status: 200 len: 1503 microversion: 2.1 time: 0.152407 Jun 07 14:53:15.668165 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 598/1185] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:53:15 2022] GET /compute/v2.1/servers/131b0b42-3011-4322-a842-a34ab7466c51 => generated 1503 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:53:16.569401 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [req-5a61b9ce-f898-4864-be31-29254b70a59d req-6bd16f7e-2344-4fef-9cbb-af7690dd6e89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "131b0b42-3011-4322-a842-a34ab7466c51", "name": "network-vif-deleted", "tag": "c746e397-360d-4b33-88ed-d2bab7f6c22c"}]} {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:53:16.579048 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [req-5a61b9ce-f898-4864-be31-29254b70a59d req-6bd16f7e-2344-4fef-9cbb-af7690dd6e89 service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:16.579494 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [req-5a61b9ce-f898-4864-be31-29254b70a59d req-6bd16f7e-2344-4fef-9cbb-af7690dd6e89 service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:16.590789 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.compute.server_external_events [req-5a61b9ce-f898-4864-be31-29254b70a59d req-6bd16f7e-2344-4fef-9cbb-af7690dd6e89 service nova] Creating event network-vif-deleted:c746e397-360d-4b33-88ed-d2bab7f6c22c for instance 131b0b42-3011-4322-a842-a34ab7466c51 on hv-cinder-84497 Jun 07 14:53:16.596065 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [req-5a61b9ce-f898-4864-be31-29254b70a59d req-6bd16f7e-2344-4fef-9cbb-af7690dd6e89 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031582 Jun 07 14:53:16.596716 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 588/1186] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jun 7 14:53:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:53:16.684845 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-9c493984-4069-4773-83ac-f3df056b98a3 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:53:16.685456 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-9c493984-4069-4773-83ac-f3df056b98a3 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] [instance: 131b0b42-3011-4322-a842-a34ab7466c51] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:53:16.691976 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-9c493984-4069-4773-83ac-f3df056b98a3 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:16.692612 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-9c493984-4069-4773-83ac-f3df056b98a3 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:16.694006 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-9c493984-4069-4773-83ac-f3df056b98a3 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:16.694438 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-9c493984-4069-4773-83ac-f3df056b98a3 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:16.759629 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-9c493984-4069-4773-83ac-f3df056b98a3 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2228e3ceb4c4f94bf4207ee9a8aac98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005732c774f145ffadd2a7bcb3049f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:53:16.767180 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-9c493984-4069-4773-83ac-f3df056b98a3 tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] 10.222.0.85 "GET /compute/v2.1/servers/131b0b42-3011-4322-a842-a34ab7466c51" status: 200 len: 1461 microversion: 2.1 time: 0.086162 Jun 07 14:53:16.767735 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 599/1187] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:53:16 2022] GET /compute/v2.1/servers/131b0b42-3011-4322-a842-a34ab7466c51 => generated 1461 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:53:17.784390 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-a281136a-899a-49bd-8893-9fa8f76d073e tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:53:17.785291 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-a281136a-899a-49bd-8893-9fa8f76d073e tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] [instance: 131b0b42-3011-4322-a842-a34ab7466c51] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:53:17.792966 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-a281136a-899a-49bd-8893-9fa8f76d073e tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:17.794323 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-a281136a-899a-49bd-8893-9fa8f76d073e tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:17.794323 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-a281136a-899a-49bd-8893-9fa8f76d073e tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:17.794653 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-a281136a-899a-49bd-8893-9fa8f76d073e tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:17.810120 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.wsgi [None req-a281136a-899a-49bd-8893-9fa8f76d073e tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] HTTP exception thrown: Instance 131b0b42-3011-4322-a842-a34ab7466c51 could not be found. Jun 07 14:53:17.811769 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-a281136a-899a-49bd-8893-9fa8f76d073e tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Request method failure captured: Jun 07 14:53:17.811769 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: request: GET /compute/v2.1/servers/131b0b42-3011-4322-a842-a34ab7466c51 HTTP/1.1 Jun 07 14:53:17.811769 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Accept: application/json Jun 07 14:53:17.811769 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Accept-Encoding: identity Jun 07 14:53:17.811769 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Connection: close Jun 07 14:53:17.811769 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Content-Length: 0 Jun 07 14:53:17.811769 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Content-Type: application/json Jun 07 14:53:17.811769 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Host: 10.222.0.85 Jun 07 14:53:17.811769 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Openstack-System-Scope: None Jun 07 14:53:17.811769 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: User-Agent: python-urllib3/1.26.9 Jun 07 14:53:17.811769 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Auth-Token: gAAAAABin2Yu4OmtXHJHi8W-G0UVzvlEfA-Abx6E_7xan_8qlGT6PSK0ZprgIINKvDNNCMNmS6lfJkT5ENrXI7UUGqrtnoEyKNMQv7DAdAfMOQ3MJDn2M7L2KlX5p0CS1MZQRjJGMTNRbHBMQGagZBpTGJdxcZo7TN3Sxnk-wAlsRK3t6qO2v6I Jun 07 14:53:17.811769 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Domain-Id: None Jun 07 14:53:17.811769 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Domain-Name: None Jun 07 14:53:17.811769 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Identity-Status: Confirmed Jun 07 14:53:17.811769 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Is-Admin-Project: True Jun 07 14:53:17.811769 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Project-Domain-Id: default Jun 07 14:53:17.811769 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Project-Domain-Name: Default Jun 07 14:53:17.811769 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Project-Id: 005732c774f145ffadd2a7bcb3049f26 Jun 07 14:53:17.811769 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Project-Name: tempest-VolumesActionsTest-1136474101 Jun 07 14:53:17.811769 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Role: member,reader Jun 07 14:53:17.811769 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Roles: member,reader Jun 07 14:53:17.813364 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/005732c774f145ffadd2a7bcb3049f26"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_005732c774f145ffadd2a7bcb3049f26"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/005732c774f145ffadd2a7bcb3049f26"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/005732c774f145ffadd2a7bcb3049f26"}]}] Jun 07 14:53:17.813364 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Tenant: tempest-VolumesActionsTest-1136474101 Jun 07 14:53:17.813364 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Tenant-Id: 005732c774f145ffadd2a7bcb3049f26 Jun 07 14:53:17.813364 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Tenant-Name: tempest-VolumesActionsTest-1136474101 Jun 07 14:53:17.813364 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User: tempest-VolumesActionsTest-1136474101-project Jun 07 14:53:17.813364 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User-Domain-Id: default Jun 07 14:53:17.813364 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User-Domain-Name: Default Jun 07 14:53:17.813364 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User-Id: d2228e3ceb4c4f94bf4207ee9a8aac98 Jun 07 14:53:17.813364 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User-Name: tempest-VolumesActionsTest-1136474101-project Jun 07 14:53:17.813364 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: method: > Jun 07 14:53:17.813364 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: exception: Instance 131b0b42-3011-4322-a842-a34ab7466c51 could not be found. Jun 07 14:53:17.813364 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: action_args: {'id': '131b0b42-3011-4322-a842-a34ab7466c51'} Jun 07 14:53:17.814171 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:53:17.814171 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:53:17.814171 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 14:53:17.814171 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 14:53:17.814171 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 14:53:17.814171 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 14:53:17.814171 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 14:53:17.814171 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 14:53:17.814171 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 14:53:17.814171 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 14:53:17.814171 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 131b0b42-3011-4322-a842-a34ab7466c51 could not be found. Jun 07 14:53:17.814171 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:53:17.814171 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:53:17.814171 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:53:17.814171 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:53:17.814171 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:53:17.814171 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:53:17.814171 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:53:17.814171 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:53:17.814171 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:53:17.815552 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:53:17.815552 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 14:53:17.815552 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 14:53:17.815552 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 14:53:17.815552 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 14:53:17.815552 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 14:53:17.815552 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:53:17.815552 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 131b0b42-3011-4322-a842-a34ab7466c51 could not be found. Jun 07 14:53:17.815552 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:53:17.815552 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:53:17.815552 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:53:17.815552 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:53:17.815552 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:53:17.815552 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:53:17.815552 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:53:17.815552 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:53:17.815552 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 131b0b42-3011-4322-a842-a34ab7466c51 could not be found. Jun 07 14:53:17.815552 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:53:17.816813 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-a281136a-899a-49bd-8893-9fa8f76d073e tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] Returning 404 to user: Instance 131b0b42-3011-4322-a842-a34ab7466c51 could not be found. {{(pid=118157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:53:17.816813 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-a281136a-899a-49bd-8893-9fa8f76d073e tempest-VolumesActionsTest-1136474101 tempest-VolumesActionsTest-1136474101-project] 10.222.0.85 "GET /compute/v2.1/servers/131b0b42-3011-4322-a842-a34ab7466c51" status: 404 len: 111 microversion: 2.1 time: 0.033158 Jun 07 14:53:17.816813 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 589/1188] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:53:17 2022] GET /compute/v2.1/servers/131b0b42-3011-4322-a842-a34ab7466c51 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 14:53:21.232858 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-efb25c92-4f7a-4719-ad4d-c75d3ce76535 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:53:21.233967 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-efb25c92-4f7a-4719-ad4d-c75d3ce76535 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: 7bae9245-118c-4121-b43a-307dd6046a75] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:53:21.236794 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG dbcounter [-] [118158] Writing DB stats nova_cell0:SELECT=4 {{(pid=118158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:53:21.241244 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-efb25c92-4f7a-4719-ad4d-c75d3ce76535 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:21.242048 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-efb25c92-4f7a-4719-ad4d-c75d3ce76535 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:21.242671 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-efb25c92-4f7a-4719-ad4d-c75d3ce76535 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:21.243204 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-efb25c92-4f7a-4719-ad4d-c75d3ce76535 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:21.248418 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG dbcounter [-] [118158] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:53:21.273218 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-efb25c92-4f7a-4719-ad4d-c75d3ce76535 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: 7bae9245-118c-4121-b43a-307dd6046a75] Going to try to terminate instance {{(pid=118158) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 14:53:21.306819 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [req-26a14bf7-4049-4bc3-8962-754a41016297 req-5fb92d87-1752-4b71-890a-0170aafbdfad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bae9245-118c-4121-b43a-307dd6046a75", "tag": "d401233f-31c8-4f31-89d5-7671349fd7e0"}]} {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:53:21.311347 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG dbcounter [-] [118157] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=118157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:53:21.316628 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [req-26a14bf7-4049-4bc3-8962-754a41016297 req-5fb92d87-1752-4b71-890a-0170aafbdfad service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:21.317075 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [req-26a14bf7-4049-4bc3-8962-754a41016297 req-5fb92d87-1752-4b71-890a-0170aafbdfad service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:21.328365 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.compute.server_external_events [req-26a14bf7-4049-4bc3-8962-754a41016297 req-5fb92d87-1752-4b71-890a-0170aafbdfad service nova] Creating event network-changed:d401233f-31c8-4f31-89d5-7671349fd7e0 for instance 7bae9245-118c-4121-b43a-307dd6046a75 on hv-cinder-84497 Jun 07 14:53:21.333564 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [req-26a14bf7-4049-4bc3-8962-754a41016297 req-5fb92d87-1752-4b71-890a-0170aafbdfad service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107844 Jun 07 14:53:21.334154 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 590/1189] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jun 7 14:53:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:53:21.603596 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-efb25c92-4f7a-4719-ad4d-c75d3ce76535 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "DELETE /compute/v2.1/servers/7bae9245-118c-4121-b43a-307dd6046a75" status: 204 len: 0 microversion: 2.1 time: 0.384390 Jun 07 14:53:21.604168 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 600/1190] 10.222.0.85 () {58 vars in 1238 bytes} [Tue Jun 7 14:53:21 2022] DELETE /compute/v2.1/servers/7bae9245-118c-4121-b43a-307dd6046a75 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 14:53:21.612863 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-3806f6a6-54f4-4856-ba28-58f54a220997 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:53:21.618159 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-3806f6a6-54f4-4856-ba28-58f54a220997 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: 7bae9245-118c-4121-b43a-307dd6046a75] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:53:21.620355 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-3806f6a6-54f4-4856-ba28-58f54a220997 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:21.620840 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-3806f6a6-54f4-4856-ba28-58f54a220997 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:21.621610 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-3806f6a6-54f4-4856-ba28-58f54a220997 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:21.622046 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-3806f6a6-54f4-4856-ba28-58f54a220997 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:21.755402 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-3806f6a6-54f4-4856-ba28-58f54a220997 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15f5fa82414bdf8ca3f6723c0a8d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e877695d0f46339cb4b9b86aac3662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:53:21.763516 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-3806f6a6-54f4-4856-ba28-58f54a220997 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "GET /compute/v2.1/servers/7bae9245-118c-4121-b43a-307dd6046a75" status: 200 len: 1577 microversion: 2.1 time: 0.154891 Jun 07 14:53:21.764170 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 591/1191] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:53:21 2022] GET /compute/v2.1/servers/7bae9245-118c-4121-b43a-307dd6046a75 => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:53:22.783570 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-1ff73b51-d392-452d-9740-7e911df1b789 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:53:22.784274 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-1ff73b51-d392-452d-9740-7e911df1b789 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: 7bae9245-118c-4121-b43a-307dd6046a75] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:53:22.791499 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-1ff73b51-d392-452d-9740-7e911df1b789 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:22.792084 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-1ff73b51-d392-452d-9740-7e911df1b789 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:22.793102 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-1ff73b51-d392-452d-9740-7e911df1b789 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:22.793776 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-1ff73b51-d392-452d-9740-7e911df1b789 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:22.931228 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-1ff73b51-d392-452d-9740-7e911df1b789 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15f5fa82414bdf8ca3f6723c0a8d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e877695d0f46339cb4b9b86aac3662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:53:22.939220 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-1ff73b51-d392-452d-9740-7e911df1b789 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "GET /compute/v2.1/servers/7bae9245-118c-4121-b43a-307dd6046a75" status: 200 len: 1577 microversion: 2.1 time: 0.159782 Jun 07 14:53:22.940143 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 601/1192] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:53:22 2022] GET /compute/v2.1/servers/7bae9245-118c-4121-b43a-307dd6046a75 => generated 1577 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:53:23.956116 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-e77c5f28-e2de-4b96-af27-df9254a4b28b tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:53:23.956742 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-e77c5f28-e2de-4b96-af27-df9254a4b28b tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: 7bae9245-118c-4121-b43a-307dd6046a75] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:53:23.963342 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-e77c5f28-e2de-4b96-af27-df9254a4b28b tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:23.963791 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-e77c5f28-e2de-4b96-af27-df9254a4b28b tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:23.964607 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-e77c5f28-e2de-4b96-af27-df9254a4b28b tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:23.965041 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-e77c5f28-e2de-4b96-af27-df9254a4b28b tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:24.099863 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-e77c5f28-e2de-4b96-af27-df9254a4b28b tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15f5fa82414bdf8ca3f6723c0a8d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e877695d0f46339cb4b9b86aac3662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:53:24.106544 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-e77c5f28-e2de-4b96-af27-df9254a4b28b tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "GET /compute/v2.1/servers/7bae9245-118c-4121-b43a-307dd6046a75" status: 200 len: 1577 microversion: 2.1 time: 0.154312 Jun 07 14:53:24.107100 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 592/1193] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:53:23 2022] GET /compute/v2.1/servers/7bae9245-118c-4121-b43a-307dd6046a75 => generated 1577 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:53:25.123996 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-7040eda7-e086-4797-bfda-8a47baeffb8e tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:53:25.124639 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-7040eda7-e086-4797-bfda-8a47baeffb8e tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: 7bae9245-118c-4121-b43a-307dd6046a75] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:53:25.131211 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-7040eda7-e086-4797-bfda-8a47baeffb8e tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:25.131657 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-7040eda7-e086-4797-bfda-8a47baeffb8e tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:25.132441 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-7040eda7-e086-4797-bfda-8a47baeffb8e tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:25.132880 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-7040eda7-e086-4797-bfda-8a47baeffb8e tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:25.267239 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-7040eda7-e086-4797-bfda-8a47baeffb8e tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15f5fa82414bdf8ca3f6723c0a8d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e877695d0f46339cb4b9b86aac3662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:53:25.274779 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-7040eda7-e086-4797-bfda-8a47baeffb8e tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "GET /compute/v2.1/servers/7bae9245-118c-4121-b43a-307dd6046a75" status: 200 len: 1577 microversion: 2.1 time: 0.154660 Jun 07 14:53:25.275332 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 602/1194] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:53:25 2022] GET /compute/v2.1/servers/7bae9245-118c-4121-b43a-307dd6046a75 => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:53:26.291684 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-fcdda015-c6dd-4398-9fca-3b54972e195f tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:53:26.292284 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-fcdda015-c6dd-4398-9fca-3b54972e195f tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: 7bae9245-118c-4121-b43a-307dd6046a75] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:53:26.298826 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-fcdda015-c6dd-4398-9fca-3b54972e195f tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:26.299300 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-fcdda015-c6dd-4398-9fca-3b54972e195f tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:26.300046 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-fcdda015-c6dd-4398-9fca-3b54972e195f tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:26.300522 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-fcdda015-c6dd-4398-9fca-3b54972e195f tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:26.449367 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-fcdda015-c6dd-4398-9fca-3b54972e195f tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15f5fa82414bdf8ca3f6723c0a8d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e877695d0f46339cb4b9b86aac3662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:53:26.457141 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-fcdda015-c6dd-4398-9fca-3b54972e195f tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "GET /compute/v2.1/servers/7bae9245-118c-4121-b43a-307dd6046a75" status: 200 len: 1577 microversion: 2.1 time: 0.169280 Jun 07 14:53:26.457703 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 593/1195] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:53:26 2022] GET /compute/v2.1/servers/7bae9245-118c-4121-b43a-307dd6046a75 => generated 1577 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:53:27.475235 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-22eadea0-3a28-4526-a3db-c30b712ed187 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:53:27.475873 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-22eadea0-3a28-4526-a3db-c30b712ed187 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: 7bae9245-118c-4121-b43a-307dd6046a75] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:53:27.482771 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-22eadea0-3a28-4526-a3db-c30b712ed187 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:27.483221 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-22eadea0-3a28-4526-a3db-c30b712ed187 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:27.483990 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-22eadea0-3a28-4526-a3db-c30b712ed187 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:27.484454 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-22eadea0-3a28-4526-a3db-c30b712ed187 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:27.619950 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-22eadea0-3a28-4526-a3db-c30b712ed187 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15f5fa82414bdf8ca3f6723c0a8d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e877695d0f46339cb4b9b86aac3662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:53:27.627490 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-22eadea0-3a28-4526-a3db-c30b712ed187 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "GET /compute/v2.1/servers/7bae9245-118c-4121-b43a-307dd6046a75" status: 200 len: 1577 microversion: 2.1 time: 0.156277 Jun 07 14:53:27.628052 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 603/1196] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:53:27 2022] GET /compute/v2.1/servers/7bae9245-118c-4121-b43a-307dd6046a75 => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:53:28.645610 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-f366f74a-24c1-4106-b304-c27dc260330d tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:53:28.646832 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-f366f74a-24c1-4106-b304-c27dc260330d tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: 7bae9245-118c-4121-b43a-307dd6046a75] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:53:28.653521 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-f366f74a-24c1-4106-b304-c27dc260330d tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:28.653972 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-f366f74a-24c1-4106-b304-c27dc260330d tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:28.654789 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-f366f74a-24c1-4106-b304-c27dc260330d tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:28.655223 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-f366f74a-24c1-4106-b304-c27dc260330d tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:28.802972 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-f366f74a-24c1-4106-b304-c27dc260330d tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15f5fa82414bdf8ca3f6723c0a8d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e877695d0f46339cb4b9b86aac3662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:53:28.813063 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-f366f74a-24c1-4106-b304-c27dc260330d tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "GET /compute/v2.1/servers/7bae9245-118c-4121-b43a-307dd6046a75" status: 200 len: 1577 microversion: 2.1 time: 0.171672 Jun 07 14:53:28.813718 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 594/1197] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:53:28 2022] GET /compute/v2.1/servers/7bae9245-118c-4121-b43a-307dd6046a75 => generated 1577 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:53:29.833144 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-8fb46b7f-7c4b-45fa-a8f1-52ac6f64a5dd tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:53:29.834758 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-8fb46b7f-7c4b-45fa-a8f1-52ac6f64a5dd tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: 7bae9245-118c-4121-b43a-307dd6046a75] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:53:29.843790 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-8fb46b7f-7c4b-45fa-a8f1-52ac6f64a5dd tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:29.844671 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-8fb46b7f-7c4b-45fa-a8f1-52ac6f64a5dd tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:29.845876 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-8fb46b7f-7c4b-45fa-a8f1-52ac6f64a5dd tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:29.846309 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-8fb46b7f-7c4b-45fa-a8f1-52ac6f64a5dd tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:30.029703 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-8fb46b7f-7c4b-45fa-a8f1-52ac6f64a5dd tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15f5fa82414bdf8ca3f6723c0a8d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e877695d0f46339cb4b9b86aac3662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:53:30.037702 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-8fb46b7f-7c4b-45fa-a8f1-52ac6f64a5dd tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "GET /compute/v2.1/servers/7bae9245-118c-4121-b43a-307dd6046a75" status: 200 len: 1577 microversion: 2.1 time: 0.208618 Jun 07 14:53:30.038506 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 604/1198] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:53:29 2022] GET /compute/v2.1/servers/7bae9245-118c-4121-b43a-307dd6046a75 => generated 1577 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:53:31.057937 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-67f9dd4c-b3c7-45e3-b048-58d9fced2178 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:53:31.064042 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-67f9dd4c-b3c7-45e3-b048-58d9fced2178 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: 7bae9245-118c-4121-b43a-307dd6046a75] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:53:31.073436 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-67f9dd4c-b3c7-45e3-b048-58d9fced2178 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:31.074625 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-67f9dd4c-b3c7-45e3-b048-58d9fced2178 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:31.075947 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-67f9dd4c-b3c7-45e3-b048-58d9fced2178 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:31.076564 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-67f9dd4c-b3c7-45e3-b048-58d9fced2178 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:31.245489 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-67f9dd4c-b3c7-45e3-b048-58d9fced2178 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15f5fa82414bdf8ca3f6723c0a8d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e877695d0f46339cb4b9b86aac3662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:53:31.253701 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-67f9dd4c-b3c7-45e3-b048-58d9fced2178 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "GET /compute/v2.1/servers/7bae9245-118c-4121-b43a-307dd6046a75" status: 200 len: 1577 microversion: 2.1 time: 0.199675 Jun 07 14:53:31.254560 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 595/1199] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:53:31 2022] GET /compute/v2.1/servers/7bae9245-118c-4121-b43a-307dd6046a75 => generated 1577 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:53:32.276626 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-8d67ee2d-85d8-4d89-8597-8541289a31c3 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:53:32.277317 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-8d67ee2d-85d8-4d89-8597-8541289a31c3 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: 7bae9245-118c-4121-b43a-307dd6046a75] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:53:32.284248 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-8d67ee2d-85d8-4d89-8597-8541289a31c3 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:32.284882 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-8d67ee2d-85d8-4d89-8597-8541289a31c3 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:32.285651 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-8d67ee2d-85d8-4d89-8597-8541289a31c3 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:32.286152 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-8d67ee2d-85d8-4d89-8597-8541289a31c3 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:32.458183 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-8d67ee2d-85d8-4d89-8597-8541289a31c3 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15f5fa82414bdf8ca3f6723c0a8d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e877695d0f46339cb4b9b86aac3662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:53:32.466214 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-8d67ee2d-85d8-4d89-8597-8541289a31c3 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "GET /compute/v2.1/servers/7bae9245-118c-4121-b43a-307dd6046a75" status: 200 len: 1577 microversion: 2.1 time: 0.193769 Jun 07 14:53:32.476302 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 605/1200] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:53:32 2022] GET /compute/v2.1/servers/7bae9245-118c-4121-b43a-307dd6046a75 => generated 1577 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:53:33.484057 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-1710ddb9-ead4-47b2-95d7-d2efe3103b04 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:53:33.484732 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-1710ddb9-ead4-47b2-95d7-d2efe3103b04 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: 7bae9245-118c-4121-b43a-307dd6046a75] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:53:33.492230 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-1710ddb9-ead4-47b2-95d7-d2efe3103b04 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:33.492739 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-1710ddb9-ead4-47b2-95d7-d2efe3103b04 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:33.493595 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-1710ddb9-ead4-47b2-95d7-d2efe3103b04 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:33.494048 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-1710ddb9-ead4-47b2-95d7-d2efe3103b04 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:33.641258 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-1710ddb9-ead4-47b2-95d7-d2efe3103b04 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15f5fa82414bdf8ca3f6723c0a8d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e877695d0f46339cb4b9b86aac3662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:53:33.649866 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-1710ddb9-ead4-47b2-95d7-d2efe3103b04 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "GET /compute/v2.1/servers/7bae9245-118c-4121-b43a-307dd6046a75" status: 200 len: 1577 microversion: 2.1 time: 0.169908 Jun 07 14:53:33.650959 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 596/1201] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:53:33 2022] GET /compute/v2.1/servers/7bae9245-118c-4121-b43a-307dd6046a75 => generated 1577 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:53:34.335446 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [req-3790dddc-ad6c-4115-9a08-27bf203e568a req-bb24ab16-36d4-4033-9d46-db84cc6c10ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bae9245-118c-4121-b43a-307dd6046a75", "name": "network-vif-unplugged", "status": "completed", "tag": "d401233f-31c8-4f31-89d5-7671349fd7e0"}]} {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:53:34.351423 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [req-3790dddc-ad6c-4115-9a08-27bf203e568a req-bb24ab16-36d4-4033-9d46-db84cc6c10ed service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:34.353063 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [req-3790dddc-ad6c-4115-9a08-27bf203e568a req-bb24ab16-36d4-4033-9d46-db84cc6c10ed service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:34.375009 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.compute.server_external_events [req-3790dddc-ad6c-4115-9a08-27bf203e568a req-bb24ab16-36d4-4033-9d46-db84cc6c10ed service nova] Creating event network-vif-unplugged:d401233f-31c8-4f31-89d5-7671349fd7e0 for instance 7bae9245-118c-4121-b43a-307dd6046a75 on hv-cinder-84497 Jun 07 14:53:34.383972 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [req-3790dddc-ad6c-4115-9a08-27bf203e568a req-bb24ab16-36d4-4033-9d46-db84cc6c10ed service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052303 Jun 07 14:53:34.389074 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 606/1202] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jun 7 14:53:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:53:34.671218 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-e5b3027f-6ae7-4243-ad5d-7b5755b76730 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:53:34.673070 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-e5b3027f-6ae7-4243-ad5d-7b5755b76730 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: 7bae9245-118c-4121-b43a-307dd6046a75] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:53:34.682229 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-e5b3027f-6ae7-4243-ad5d-7b5755b76730 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:34.683169 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-e5b3027f-6ae7-4243-ad5d-7b5755b76730 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:34.684162 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-e5b3027f-6ae7-4243-ad5d-7b5755b76730 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:34.684843 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-e5b3027f-6ae7-4243-ad5d-7b5755b76730 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:35.015859 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-e5b3027f-6ae7-4243-ad5d-7b5755b76730 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15f5fa82414bdf8ca3f6723c0a8d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e877695d0f46339cb4b9b86aac3662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:53:35.025016 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-e5b3027f-6ae7-4243-ad5d-7b5755b76730 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "GET /compute/v2.1/servers/7bae9245-118c-4121-b43a-307dd6046a75" status: 200 len: 1458 microversion: 2.1 time: 0.359169 Jun 07 14:53:35.025803 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 597/1203] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:53:34 2022] GET /compute/v2.1/servers/7bae9245-118c-4121-b43a-307dd6046a75 => generated 1458 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:53:35.283197 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [req-2efc730e-4ea8-49b9-9cb0-b0eb492c94b2 req-58c83c93-41e3-4499-bbe0-645580d80838 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bae9245-118c-4121-b43a-307dd6046a75", "name": "network-vif-deleted", "tag": "d401233f-31c8-4f31-89d5-7671349fd7e0"}]} {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:53:35.292976 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [req-2efc730e-4ea8-49b9-9cb0-b0eb492c94b2 req-58c83c93-41e3-4499-bbe0-645580d80838 service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:35.293744 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [req-2efc730e-4ea8-49b9-9cb0-b0eb492c94b2 req-58c83c93-41e3-4499-bbe0-645580d80838 service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:35.306272 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.compute.server_external_events [req-2efc730e-4ea8-49b9-9cb0-b0eb492c94b2 req-58c83c93-41e3-4499-bbe0-645580d80838 service nova] Creating event network-vif-deleted:d401233f-31c8-4f31-89d5-7671349fd7e0 for instance 7bae9245-118c-4121-b43a-307dd6046a75 on hv-cinder-84497 Jun 07 14:53:35.315183 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [req-2efc730e-4ea8-49b9-9cb0-b0eb492c94b2 req-58c83c93-41e3-4499-bbe0-645580d80838 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036259 Jun 07 14:53:35.315828 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 607/1204] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jun 7 14:53:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:53:36.044989 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-0e9daee8-6429-4dc7-b561-e3b6af2488f7 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:53:36.046462 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-0e9daee8-6429-4dc7-b561-e3b6af2488f7 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: 7bae9245-118c-4121-b43a-307dd6046a75] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:53:36.054066 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-0e9daee8-6429-4dc7-b561-e3b6af2488f7 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:36.054880 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-0e9daee8-6429-4dc7-b561-e3b6af2488f7 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:36.055944 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-0e9daee8-6429-4dc7-b561-e3b6af2488f7 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:36.056488 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-0e9daee8-6429-4dc7-b561-e3b6af2488f7 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:36.094888 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-0e9daee8-6429-4dc7-b561-e3b6af2488f7 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:36.095668 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-0e9daee8-6429-4dc7-b561-e3b6af2488f7 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:36.096138 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.objects.instance [None req-0e9daee8-6429-4dc7-b561-e3b6af2488f7 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lazy-loading 'fault' on Instance uuid 7bae9245-118c-4121-b43a-307dd6046a75 {{(pid=118157) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 14:53:36.147355 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-0e9daee8-6429-4dc7-b561-e3b6af2488f7 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15f5fa82414bdf8ca3f6723c0a8d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e877695d0f46339cb4b9b86aac3662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:53:36.156413 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-0e9daee8-6429-4dc7-b561-e3b6af2488f7 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "GET /compute/v2.1/servers/7bae9245-118c-4121-b43a-307dd6046a75" status: 200 len: 1230 microversion: 2.1 time: 0.114953 Jun 07 14:53:36.157669 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 598/1205] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:53:36 2022] GET /compute/v2.1/servers/7bae9245-118c-4121-b43a-307dd6046a75 => generated 1230 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:53:37.177258 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-ae4351fc-6570-4830-9503-d35ff9d6c984 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:53:37.177953 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-ae4351fc-6570-4830-9503-d35ff9d6c984 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: 7bae9245-118c-4121-b43a-307dd6046a75] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:53:37.184158 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-ae4351fc-6570-4830-9503-d35ff9d6c984 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:37.184630 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-ae4351fc-6570-4830-9503-d35ff9d6c984 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:37.185408 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-ae4351fc-6570-4830-9503-d35ff9d6c984 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:37.185820 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-ae4351fc-6570-4830-9503-d35ff9d6c984 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:37.199611 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.wsgi [None req-ae4351fc-6570-4830-9503-d35ff9d6c984 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] HTTP exception thrown: Instance 7bae9245-118c-4121-b43a-307dd6046a75 could not be found. Jun 07 14:53:37.201301 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-ae4351fc-6570-4830-9503-d35ff9d6c984 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Request method failure captured: Jun 07 14:53:37.201301 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: request: GET /compute/v2.1/servers/7bae9245-118c-4121-b43a-307dd6046a75 HTTP/1.1 Jun 07 14:53:37.201301 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Accept: application/json Jun 07 14:53:37.201301 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Accept-Encoding: identity Jun 07 14:53:37.201301 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Connection: close Jun 07 14:53:37.201301 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Content-Length: 0 Jun 07 14:53:37.201301 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Content-Type: application/json Jun 07 14:53:37.201301 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Host: 10.222.0.85 Jun 07 14:53:37.201301 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Openstack-System-Scope: None Jun 07 14:53:37.201301 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: User-Agent: python-urllib3/1.26.9 Jun 07 14:53:37.201301 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Auth-Token: gAAAAABin2PUqFwU0AvmOqgQNDY4J595fARbGRNudVshtvt4BECAbce2SeSyZ4ADP2Iau0xa-EhBJXaAKOTzJ6BR3V1eowASX2CJpSAhimVWcEo1dNqlj_TVzaqOJjEHBniJA_cMp1TlqS665UYoJ3dgIqGoQK7oDPSO8yRQ-fWSdwHmmcw0uR8 Jun 07 14:53:37.201301 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Domain-Id: None Jun 07 14:53:37.201301 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Domain-Name: None Jun 07 14:53:37.201301 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Identity-Status: Confirmed Jun 07 14:53:37.201301 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Is-Admin-Project: True Jun 07 14:53:37.201301 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Domain-Id: default Jun 07 14:53:37.201301 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Domain-Name: Default Jun 07 14:53:37.201301 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Id: 93e877695d0f46339cb4b9b86aac3662 Jun 07 14:53:37.201301 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Name: tempest-TestVolumeBootPattern-338121805 Jun 07 14:53:37.201301 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Role: member,reader Jun 07 14:53:37.201301 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Roles: member,reader Jun 07 14:53:37.203113 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/93e877695d0f46339cb4b9b86aac3662"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_93e877695d0f46339cb4b9b86aac3662"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/93e877695d0f46339cb4b9b86aac3662"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/93e877695d0f46339cb4b9b86aac3662"}]}] Jun 07 14:53:37.203113 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Tenant: tempest-TestVolumeBootPattern-338121805 Jun 07 14:53:37.203113 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Tenant-Id: 93e877695d0f46339cb4b9b86aac3662 Jun 07 14:53:37.203113 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Tenant-Name: tempest-TestVolumeBootPattern-338121805 Jun 07 14:53:37.203113 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User: tempest-TestVolumeBootPattern-338121805-project Jun 07 14:53:37.203113 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Domain-Id: default Jun 07 14:53:37.203113 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Domain-Name: Default Jun 07 14:53:37.203113 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Id: 0a15f5fa82414bdf8ca3f6723c0a8d2d Jun 07 14:53:37.203113 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Name: tempest-TestVolumeBootPattern-338121805-project Jun 07 14:53:37.203113 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: method: > Jun 07 14:53:37.203113 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: exception: Instance 7bae9245-118c-4121-b43a-307dd6046a75 could not be found. Jun 07 14:53:37.203113 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: action_args: {'id': '7bae9245-118c-4121-b43a-307dd6046a75'} Jun 07 14:53:37.204075 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:53:37.204075 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:53:37.204075 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 14:53:37.204075 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 14:53:37.204075 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 14:53:37.204075 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 14:53:37.204075 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 14:53:37.204075 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 14:53:37.204075 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 14:53:37.204075 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 14:53:37.204075 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7bae9245-118c-4121-b43a-307dd6046a75 could not be found. Jun 07 14:53:37.204075 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:53:37.204075 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:53:37.204075 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:53:37.204075 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:53:37.204075 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:53:37.204075 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:53:37.204075 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:53:37.204075 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:53:37.204075 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:53:37.205944 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:53:37.205944 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 14:53:37.205944 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 14:53:37.205944 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 14:53:37.205944 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 14:53:37.205944 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 14:53:37.205944 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:53:37.205944 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7bae9245-118c-4121-b43a-307dd6046a75 could not be found. Jun 07 14:53:37.205944 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:53:37.205944 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:53:37.205944 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:53:37.205944 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:53:37.205944 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:53:37.205944 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:53:37.205944 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:53:37.205944 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:53:37.205944 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7bae9245-118c-4121-b43a-307dd6046a75 could not be found. Jun 07 14:53:37.205944 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:53:37.207682 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-ae4351fc-6570-4830-9503-d35ff9d6c984 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Returning 404 to user: Instance 7bae9245-118c-4121-b43a-307dd6046a75 could not be found. {{(pid=118158) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:53:37.207682 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-ae4351fc-6570-4830-9503-d35ff9d6c984 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "GET /compute/v2.1/servers/7bae9245-118c-4121-b43a-307dd6046a75" status: 404 len: 111 microversion: 2.1 time: 0.030117 Jun 07 14:53:37.207682 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 608/1206] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:53:37 2022] GET /compute/v2.1/servers/7bae9245-118c-4121-b43a-307dd6046a75 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 14:53:37.740523 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-457a5ffe-fec6-4e52-b7d8-879ebe21d5ad tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2119924239", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-492376855", "security_groups": [{"name": "tempest-secgroup-smoke-1123810834"}], "networks": [{"uuid": "f44fe8eb-9989-42c6-a1c9-7ebaf8211519"}], "block_device_mapping_v2": [{"uuid": "e53a1402-cc19-4d56-84be-e8e5b667f03c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:53:37.884805 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.network.neutron [None req-457a5ffe-fec6-4e52-b7d8-879ebe21d5ad tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] validate_networks() for [('f44fe8eb-9989-42c6-a1c9-7ebaf8211519', None, None, None, None, None)] {{(pid=118157) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 14:53:38.408394 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.virt.hardware [None req-457a5ffe-fec6-4e52-b7d8-879ebe21d5ad tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Flavor limits 0:0:0 {{(pid=118157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 14:53:38.408967 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.virt.hardware [None req-457a5ffe-fec6-4e52-b7d8-879ebe21d5ad tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Image limits 0:0:0 {{(pid=118157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 14:53:38.409527 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.virt.hardware [None req-457a5ffe-fec6-4e52-b7d8-879ebe21d5ad tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Flavor pref 0:0:0 {{(pid=118157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 14:53:38.409982 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.virt.hardware [None req-457a5ffe-fec6-4e52-b7d8-879ebe21d5ad tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Image pref 0:0:0 {{(pid=118157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 14:53:38.410632 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.virt.hardware [None req-457a5ffe-fec6-4e52-b7d8-879ebe21d5ad tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 14:53:38.423281 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-457a5ffe-fec6-4e52-b7d8-879ebe21d5ad tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:38.423828 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-457a5ffe-fec6-4e52-b7d8-879ebe21d5ad tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:38.425249 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-457a5ffe-fec6-4e52-b7d8-879ebe21d5ad tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:38.426018 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-457a5ffe-fec6-4e52-b7d8-879ebe21d5ad tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:38.467316 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.quota [None req-457a5ffe-fec6-4e52-b7d8-879ebe21d5ad tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Getting quotas for project deac7502c4684bdcb5dd9151d6c09894. Resources: {'instances', 'cores', 'ram'} {{(pid=118157) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 14:53:38.474807 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.quota [None req-457a5ffe-fec6-4e52-b7d8-879ebe21d5ad tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Getting quotas for user 9e7e40e0dfbf49a58d67b897f4792399 and project deac7502c4684bdcb5dd9151d6c09894. Resources: {'instances', 'cores', 'ram'} {{(pid=118157) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 14:53:38.559320 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-457a5ffe-fec6-4e52-b7d8-879ebe21d5ad tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Going to run 1 instances... {{(pid=118157) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 14:53:38.561810 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-457a5ffe-fec6-4e52-b7d8-879ebe21d5ad tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] [instance: f56554dc-d349-4e0b-95b9-e86891387def] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e53a1402-cc19-4d56-84be-e8e5b667f03c',volume_size=None,volume_type=None)] {{(pid=118157) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 14:53:39.078992 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-457a5ffe-fec6-4e52-b7d8-879ebe21d5ad tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.344049 Jun 07 14:53:39.080513 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 599/1207] 10.222.0.85 () {60 vars in 1146 bytes} [Tue Jun 7 14:53:37 2022] POST /compute/v2.1/servers => generated 406 bytes in 1347 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 07 14:53:39.090692 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-b5273541-987b-4c8a-a845-193366014593 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:53:39.091972 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-b5273541-987b-4c8a-a845-193366014593 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] [instance: f56554dc-d349-4e0b-95b9-e86891387def] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:53:39.156505 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-b5273541-987b-4c8a-a845-193366014593 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7e40e0dfbf49a58d67b897f4792399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deac7502c4684bdcb5dd9151d6c09894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:53:39.187643 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-b5273541-987b-4c8a-a845-193366014593 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] 10.222.0.85 "GET /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def" status: 200 len: 1088 microversion: 2.1 time: 0.077358 Jun 07 14:53:39.187643 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 609/1208] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:53:39 2022] GET /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def => generated 1088 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:53:40.197009 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-d6385759-1f6b-41b1-be5a-bc7e94305ad0 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:53:40.198617 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-d6385759-1f6b-41b1-be5a-bc7e94305ad0 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] [instance: f56554dc-d349-4e0b-95b9-e86891387def] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:53:40.256991 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-d6385759-1f6b-41b1-be5a-bc7e94305ad0 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7e40e0dfbf49a58d67b897f4792399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deac7502c4684bdcb5dd9151d6c09894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:53:40.265510 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-d6385759-1f6b-41b1-be5a-bc7e94305ad0 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] 10.222.0.85 "GET /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def" status: 200 len: 1088 microversion: 2.1 time: 0.073863 Jun 07 14:53:40.266328 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 600/1209] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:53:40 2022] GET /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def => generated 1088 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:53:41.283515 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-6adb7ed7-d09b-4580-bf82-a05e9f730969 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:53:41.284268 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-6adb7ed7-d09b-4580-bf82-a05e9f730969 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] [instance: f56554dc-d349-4e0b-95b9-e86891387def] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:53:41.293470 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-6adb7ed7-d09b-4580-bf82-a05e9f730969 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:41.293923 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-6adb7ed7-d09b-4580-bf82-a05e9f730969 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:41.294846 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-6adb7ed7-d09b-4580-bf82-a05e9f730969 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:41.295285 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-6adb7ed7-d09b-4580-bf82-a05e9f730969 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:41.357574 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-6adb7ed7-d09b-4580-bf82-a05e9f730969 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7e40e0dfbf49a58d67b897f4792399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deac7502c4684bdcb5dd9151d6c09894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:53:41.365590 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-6adb7ed7-d09b-4580-bf82-a05e9f730969 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] 10.222.0.85 "GET /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def" status: 200 len: 1186 microversion: 2.1 time: 0.085957 Jun 07 14:53:41.366087 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 610/1210] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:53:41 2022] GET /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def => generated 1186 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:53:42.115799 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-ea47140f-1208-4035-8c9c-083ee60fb134 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:53:42.120497 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-ea47140f-1208-4035-8c9c-083ee60fb134 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: c7578860-5e31-48e5-8a70-7c6bad9afe91] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:53:42.152763 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-ea47140f-1208-4035-8c9c-083ee60fb134 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:42.154644 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-ea47140f-1208-4035-8c9c-083ee60fb134 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:42.155683 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-ea47140f-1208-4035-8c9c-083ee60fb134 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:42.157554 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-ea47140f-1208-4035-8c9c-083ee60fb134 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:42.207997 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [req-13a600e1-029e-4ef6-a0c2-efdfa5f4b990 req-2097a81e-303d-4acc-bf85-0374aa13acd6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7578860-5e31-48e5-8a70-7c6bad9afe91", "tag": "a31fb889-4abe-498c-aa99-a0264a6ccf0a"}]} {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:53:42.219016 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-ea47140f-1208-4035-8c9c-083ee60fb134 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: c7578860-5e31-48e5-8a70-7c6bad9afe91] Going to try to terminate instance {{(pid=118157) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 14:53:42.222351 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [req-13a600e1-029e-4ef6-a0c2-efdfa5f4b990 req-2097a81e-303d-4acc-bf85-0374aa13acd6 service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:42.223105 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [req-13a600e1-029e-4ef6-a0c2-efdfa5f4b990 req-2097a81e-303d-4acc-bf85-0374aa13acd6 service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:42.237488 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.compute.server_external_events [req-13a600e1-029e-4ef6-a0c2-efdfa5f4b990 req-2097a81e-303d-4acc-bf85-0374aa13acd6 service nova] Creating event network-changed:a31fb889-4abe-498c-aa99-a0264a6ccf0a for instance c7578860-5e31-48e5-8a70-7c6bad9afe91 on hv-cinder-84497 Jun 07 14:53:42.242972 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [req-13a600e1-029e-4ef6-a0c2-efdfa5f4b990 req-2097a81e-303d-4acc-bf85-0374aa13acd6 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039932 Jun 07 14:53:42.244261 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 611/1211] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jun 7 14:53:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 14:53:42.384059 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-383150de-9936-4dab-a82c-d4626dc8e901 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:53:42.384871 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-383150de-9936-4dab-a82c-d4626dc8e901 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] [instance: f56554dc-d349-4e0b-95b9-e86891387def] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:53:42.403842 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-383150de-9936-4dab-a82c-d4626dc8e901 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:42.404408 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-383150de-9936-4dab-a82c-d4626dc8e901 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:42.405236 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-383150de-9936-4dab-a82c-d4626dc8e901 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:42.405680 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-383150de-9936-4dab-a82c-d4626dc8e901 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:42.595997 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-383150de-9936-4dab-a82c-d4626dc8e901 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7e40e0dfbf49a58d67b897f4792399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deac7502c4684bdcb5dd9151d6c09894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:53:42.599547 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-ea47140f-1208-4035-8c9c-083ee60fb134 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "DELETE /compute/v2.1/servers/c7578860-5e31-48e5-8a70-7c6bad9afe91" status: 204 len: 0 microversion: 2.1 time: 0.497567 Jun 07 14:53:42.604414 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 601/1212] 10.222.0.85 () {58 vars in 1238 bytes} [Tue Jun 7 14:53:42 2022] DELETE /compute/v2.1/servers/c7578860-5e31-48e5-8a70-7c6bad9afe91 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 14:53:42.609289 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-7befc349-2b02-4796-afa0-ccd868bbbd9e tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:53:42.613264 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-383150de-9936-4dab-a82c-d4626dc8e901 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] 10.222.0.85 "GET /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def" status: 200 len: 1204 microversion: 2.1 time: 0.231067 Jun 07 14:53:42.613417 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-7befc349-2b02-4796-afa0-ccd868bbbd9e tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: c7578860-5e31-48e5-8a70-7c6bad9afe91] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:53:42.613518 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 612/1213] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:53:42 2022] GET /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def => generated 1204 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:53:42.633857 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-7befc349-2b02-4796-afa0-ccd868bbbd9e tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:42.634322 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-7befc349-2b02-4796-afa0-ccd868bbbd9e tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:42.635116 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-7befc349-2b02-4796-afa0-ccd868bbbd9e tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:42.635747 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-7befc349-2b02-4796-afa0-ccd868bbbd9e tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:43.059359 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-7befc349-2b02-4796-afa0-ccd868bbbd9e tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15f5fa82414bdf8ca3f6723c0a8d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e877695d0f46339cb4b9b86aac3662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:53:43.067153 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-7befc349-2b02-4796-afa0-ccd868bbbd9e tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "GET /compute/v2.1/servers/c7578860-5e31-48e5-8a70-7c6bad9afe91" status: 200 len: 1577 microversion: 2.1 time: 0.461968 Jun 07 14:53:43.072614 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 602/1214] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:53:42 2022] GET /compute/v2.1/servers/c7578860-5e31-48e5-8a70-7c6bad9afe91 => generated 1577 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:53:43.630803 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-51431ec3-74a7-4036-9b7c-c34ad3e9f188 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:53:43.632009 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-51431ec3-74a7-4036-9b7c-c34ad3e9f188 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] [instance: f56554dc-d349-4e0b-95b9-e86891387def] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:53:43.647347 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-51431ec3-74a7-4036-9b7c-c34ad3e9f188 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:43.651347 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-51431ec3-74a7-4036-9b7c-c34ad3e9f188 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:43.652198 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-51431ec3-74a7-4036-9b7c-c34ad3e9f188 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:43.652685 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-51431ec3-74a7-4036-9b7c-c34ad3e9f188 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:44.089290 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-7f92f7dc-7854-4df8-8027-a5bcfa4197cf tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:53:44.090006 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-7f92f7dc-7854-4df8-8027-a5bcfa4197cf tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: c7578860-5e31-48e5-8a70-7c6bad9afe91] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:53:44.097221 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-7f92f7dc-7854-4df8-8027-a5bcfa4197cf tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:44.098001 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-7f92f7dc-7854-4df8-8027-a5bcfa4197cf tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:44.099717 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-7f92f7dc-7854-4df8-8027-a5bcfa4197cf tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:44.100341 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-7f92f7dc-7854-4df8-8027-a5bcfa4197cf tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:44.294021 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-7f92f7dc-7854-4df8-8027-a5bcfa4197cf tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15f5fa82414bdf8ca3f6723c0a8d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e877695d0f46339cb4b9b86aac3662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:53:44.303810 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-7f92f7dc-7854-4df8-8027-a5bcfa4197cf tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "GET /compute/v2.1/servers/c7578860-5e31-48e5-8a70-7c6bad9afe91" status: 200 len: 1460 microversion: 2.1 time: 0.218267 Jun 07 14:53:44.313576 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 603/1215] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:53:44 2022] GET /compute/v2.1/servers/c7578860-5e31-48e5-8a70-7c6bad9afe91 => generated 1460 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:53:44.370198 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-51431ec3-74a7-4036-9b7c-c34ad3e9f188 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7e40e0dfbf49a58d67b897f4792399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deac7502c4684bdcb5dd9151d6c09894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:53:44.383621 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-51431ec3-74a7-4036-9b7c-c34ad3e9f188 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] 10.222.0.85 "GET /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def" status: 200 len: 1272 microversion: 2.1 time: 0.759170 Jun 07 14:53:44.395043 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 613/1216] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:53:43 2022] GET /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def => generated 1272 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:53:45.008400 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [req-f121d948-6c00-4265-b9d6-bd7acbf13a51 req-1da668a9-3a8e-4667-a64f-0061c39d3170 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7578860-5e31-48e5-8a70-7c6bad9afe91", "name": "network-vif-deleted", "tag": "a31fb889-4abe-498c-aa99-a0264a6ccf0a"}]} {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:53:45.026295 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [req-f121d948-6c00-4265-b9d6-bd7acbf13a51 req-1da668a9-3a8e-4667-a64f-0061c39d3170 service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:45.026295 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [req-f121d948-6c00-4265-b9d6-bd7acbf13a51 req-1da668a9-3a8e-4667-a64f-0061c39d3170 service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:45.041183 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.compute.server_external_events [req-f121d948-6c00-4265-b9d6-bd7acbf13a51 req-1da668a9-3a8e-4667-a64f-0061c39d3170 service nova] Creating event network-vif-deleted:a31fb889-4abe-498c-aa99-a0264a6ccf0a for instance c7578860-5e31-48e5-8a70-7c6bad9afe91 on hv-cinder-84497 Jun 07 14:53:45.047725 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [req-f121d948-6c00-4265-b9d6-bd7acbf13a51 req-1da668a9-3a8e-4667-a64f-0061c39d3170 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044713 Jun 07 14:53:45.049010 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 604/1217] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jun 7 14:53:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:53:45.327683 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-eb1afaa3-9201-4f74-a557-c7a4d7d028f1 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:53:45.327683 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-eb1afaa3-9201-4f74-a557-c7a4d7d028f1 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: c7578860-5e31-48e5-8a70-7c6bad9afe91] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:53:45.329024 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG dbcounter [-] [118158] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=2 {{(pid=118158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:53:45.330736 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-eb1afaa3-9201-4f74-a557-c7a4d7d028f1 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:45.331190 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-eb1afaa3-9201-4f74-a557-c7a4d7d028f1 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:45.331975 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-eb1afaa3-9201-4f74-a557-c7a4d7d028f1 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:45.332472 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-eb1afaa3-9201-4f74-a557-c7a4d7d028f1 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:45.404082 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-eb1afaa3-9201-4f74-a557-c7a4d7d028f1 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15f5fa82414bdf8ca3f6723c0a8d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e877695d0f46339cb4b9b86aac3662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:53:45.405031 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-e7ef5b53-3e29-45f4-84be-a8cae32602fe tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:53:45.405753 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-e7ef5b53-3e29-45f4-84be-a8cae32602fe tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] [instance: f56554dc-d349-4e0b-95b9-e86891387def] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:53:45.414698 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-eb1afaa3-9201-4f74-a557-c7a4d7d028f1 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "GET /compute/v2.1/servers/c7578860-5e31-48e5-8a70-7c6bad9afe91" status: 200 len: 1226 microversion: 2.1 time: 0.097164 Jun 07 14:53:45.415278 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 614/1218] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:53:45 2022] GET /compute/v2.1/servers/c7578860-5e31-48e5-8a70-7c6bad9afe91 => generated 1226 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:53:45.416663 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-e7ef5b53-3e29-45f4-84be-a8cae32602fe tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:45.420591 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-e7ef5b53-3e29-45f4-84be-a8cae32602fe tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:45.420591 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-e7ef5b53-3e29-45f4-84be-a8cae32602fe tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:45.420591 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-e7ef5b53-3e29-45f4-84be-a8cae32602fe tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:45.612297 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-e7ef5b53-3e29-45f4-84be-a8cae32602fe tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7e40e0dfbf49a58d67b897f4792399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deac7502c4684bdcb5dd9151d6c09894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:53:45.624163 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-e7ef5b53-3e29-45f4-84be-a8cae32602fe tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] 10.222.0.85 "GET /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def" status: 200 len: 1260 microversion: 2.1 time: 0.224853 Jun 07 14:53:45.627160 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 605/1219] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:53:45 2022] GET /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def => generated 1260 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:53:46.431732 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-50b784ef-0456-4c16-8dd5-ed57bc45316a tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:53:46.432280 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-50b784ef-0456-4c16-8dd5-ed57bc45316a tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: c7578860-5e31-48e5-8a70-7c6bad9afe91] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:53:46.439351 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-50b784ef-0456-4c16-8dd5-ed57bc45316a tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:46.439812 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-50b784ef-0456-4c16-8dd5-ed57bc45316a tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:46.440618 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-50b784ef-0456-4c16-8dd5-ed57bc45316a tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:46.441059 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-50b784ef-0456-4c16-8dd5-ed57bc45316a tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:46.477318 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-50b784ef-0456-4c16-8dd5-ed57bc45316a tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:46.477788 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-50b784ef-0456-4c16-8dd5-ed57bc45316a tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:46.478248 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.objects.instance [None req-50b784ef-0456-4c16-8dd5-ed57bc45316a tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lazy-loading 'fault' on Instance uuid c7578860-5e31-48e5-8a70-7c6bad9afe91 {{(pid=118158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 14:53:46.525685 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-50b784ef-0456-4c16-8dd5-ed57bc45316a tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a15f5fa82414bdf8ca3f6723c0a8d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e877695d0f46339cb4b9b86aac3662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:53:46.533513 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-50b784ef-0456-4c16-8dd5-ed57bc45316a tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "GET /compute/v2.1/servers/c7578860-5e31-48e5-8a70-7c6bad9afe91" status: 200 len: 1231 microversion: 2.1 time: 0.106341 Jun 07 14:53:46.534076 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 615/1220] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:53:46 2022] GET /compute/v2.1/servers/c7578860-5e31-48e5-8a70-7c6bad9afe91 => generated 1231 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:53:46.642157 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-a8c2c959-007d-40ba-901c-7be7dbea1132 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:53:46.642779 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-a8c2c959-007d-40ba-901c-7be7dbea1132 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] [instance: f56554dc-d349-4e0b-95b9-e86891387def] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:53:46.650014 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-a8c2c959-007d-40ba-901c-7be7dbea1132 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:46.650466 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-a8c2c959-007d-40ba-901c-7be7dbea1132 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:46.651229 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-a8c2c959-007d-40ba-901c-7be7dbea1132 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:46.651664 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-a8c2c959-007d-40ba-901c-7be7dbea1132 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:46.791825 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-a8c2c959-007d-40ba-901c-7be7dbea1132 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7e40e0dfbf49a58d67b897f4792399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deac7502c4684bdcb5dd9151d6c09894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:53:46.794135 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG dbcounter [-] [118157] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:53:46.800197 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-a8c2c959-007d-40ba-901c-7be7dbea1132 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] 10.222.0.85 "GET /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def" status: 200 len: 1260 microversion: 2.1 time: 0.162021 Jun 07 14:53:46.804880 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 606/1221] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:53:46 2022] GET /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:53:47.064050 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [req-ce366d6f-83b7-41f0-a1e9-9a8b4e365c77 req-594488cd-7c06-4ef4-85d1-18956a76434e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f56554dc-d349-4e0b-95b9-e86891387def", "tag": "114b12fc-435d-466d-bf5f-18df5b6bc051"}]} {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:53:47.072300 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [req-ce366d6f-83b7-41f0-a1e9-9a8b4e365c77 req-594488cd-7c06-4ef4-85d1-18956a76434e service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:47.072777 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [req-ce366d6f-83b7-41f0-a1e9-9a8b4e365c77 req-594488cd-7c06-4ef4-85d1-18956a76434e service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:47.084358 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.compute.server_external_events [req-ce366d6f-83b7-41f0-a1e9-9a8b4e365c77 req-594488cd-7c06-4ef4-85d1-18956a76434e service nova] Creating event network-changed:114b12fc-435d-466d-bf5f-18df5b6bc051 for instance f56554dc-d349-4e0b-95b9-e86891387def on hv-cinder-84497 Jun 07 14:53:47.089442 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [req-ce366d6f-83b7-41f0-a1e9-9a8b4e365c77 req-594488cd-7c06-4ef4-85d1-18956a76434e service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029424 Jun 07 14:53:47.090024 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 616/1222] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jun 7 14:53:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:53:47.555196 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-2397694b-3166-4f4c-9d6a-f59b1041c9a0 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:53:47.555808 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-2397694b-3166-4f4c-9d6a-f59b1041c9a0 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: c7578860-5e31-48e5-8a70-7c6bad9afe91] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:53:47.564361 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-2397694b-3166-4f4c-9d6a-f59b1041c9a0 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:47.568262 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-2397694b-3166-4f4c-9d6a-f59b1041c9a0 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:47.568262 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-2397694b-3166-4f4c-9d6a-f59b1041c9a0 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:47.568262 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-2397694b-3166-4f4c-9d6a-f59b1041c9a0 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:47.580322 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.wsgi [None req-2397694b-3166-4f4c-9d6a-f59b1041c9a0 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] HTTP exception thrown: Instance c7578860-5e31-48e5-8a70-7c6bad9afe91 could not be found. Jun 07 14:53:47.582037 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-2397694b-3166-4f4c-9d6a-f59b1041c9a0 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Request method failure captured: Jun 07 14:53:47.582037 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: request: GET /compute/v2.1/servers/c7578860-5e31-48e5-8a70-7c6bad9afe91 HTTP/1.1 Jun 07 14:53:47.582037 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Accept: application/json Jun 07 14:53:47.582037 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Accept-Encoding: identity Jun 07 14:53:47.582037 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Connection: close Jun 07 14:53:47.582037 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Content-Length: 0 Jun 07 14:53:47.582037 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Content-Type: application/json Jun 07 14:53:47.582037 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Host: 10.222.0.85 Jun 07 14:53:47.582037 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Openstack-System-Scope: None Jun 07 14:53:47.582037 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: User-Agent: python-urllib3/1.26.9 Jun 07 14:53:47.582037 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Auth-Token: gAAAAABin2PUqFwU0AvmOqgQNDY4J595fARbGRNudVshtvt4BECAbce2SeSyZ4ADP2Iau0xa-EhBJXaAKOTzJ6BR3V1eowASX2CJpSAhimVWcEo1dNqlj_TVzaqOJjEHBniJA_cMp1TlqS665UYoJ3dgIqGoQK7oDPSO8yRQ-fWSdwHmmcw0uR8 Jun 07 14:53:47.582037 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Domain-Id: None Jun 07 14:53:47.582037 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Domain-Name: None Jun 07 14:53:47.582037 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Identity-Status: Confirmed Jun 07 14:53:47.582037 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Is-Admin-Project: True Jun 07 14:53:47.582037 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Project-Domain-Id: default Jun 07 14:53:47.582037 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Project-Domain-Name: Default Jun 07 14:53:47.582037 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Project-Id: 93e877695d0f46339cb4b9b86aac3662 Jun 07 14:53:47.582037 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Project-Name: tempest-TestVolumeBootPattern-338121805 Jun 07 14:53:47.582037 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Role: member,reader Jun 07 14:53:47.582037 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Roles: member,reader Jun 07 14:53:47.584361 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/93e877695d0f46339cb4b9b86aac3662"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_93e877695d0f46339cb4b9b86aac3662"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/93e877695d0f46339cb4b9b86aac3662"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/93e877695d0f46339cb4b9b86aac3662"}]}] Jun 07 14:53:47.584361 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Tenant: tempest-TestVolumeBootPattern-338121805 Jun 07 14:53:47.584361 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Tenant-Id: 93e877695d0f46339cb4b9b86aac3662 Jun 07 14:53:47.584361 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Tenant-Name: tempest-TestVolumeBootPattern-338121805 Jun 07 14:53:47.584361 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User: tempest-TestVolumeBootPattern-338121805-project Jun 07 14:53:47.584361 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User-Domain-Id: default Jun 07 14:53:47.584361 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User-Domain-Name: Default Jun 07 14:53:47.584361 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User-Id: 0a15f5fa82414bdf8ca3f6723c0a8d2d Jun 07 14:53:47.584361 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User-Name: tempest-TestVolumeBootPattern-338121805-project Jun 07 14:53:47.584361 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: method: > Jun 07 14:53:47.584361 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: exception: Instance c7578860-5e31-48e5-8a70-7c6bad9afe91 could not be found. Jun 07 14:53:47.584361 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: action_args: {'id': 'c7578860-5e31-48e5-8a70-7c6bad9afe91'} Jun 07 14:53:47.585351 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:53:47.585351 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:53:47.585351 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 14:53:47.585351 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 14:53:47.585351 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 14:53:47.585351 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 14:53:47.585351 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 14:53:47.585351 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 14:53:47.585351 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 14:53:47.585351 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 14:53:47.585351 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7578860-5e31-48e5-8a70-7c6bad9afe91 could not be found. Jun 07 14:53:47.585351 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:53:47.585351 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:53:47.585351 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:53:47.585351 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:53:47.585351 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:53:47.585351 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:53:47.585351 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:53:47.585351 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:53:47.585351 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:53:47.586952 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:53:47.586952 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 14:53:47.586952 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 14:53:47.586952 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 14:53:47.586952 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 14:53:47.586952 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 14:53:47.586952 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:53:47.586952 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7578860-5e31-48e5-8a70-7c6bad9afe91 could not be found. Jun 07 14:53:47.586952 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:53:47.586952 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:53:47.586952 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:53:47.586952 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:53:47.586952 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:53:47.586952 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:53:47.586952 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:53:47.586952 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:53:47.586952 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7578860-5e31-48e5-8a70-7c6bad9afe91 could not be found. Jun 07 14:53:47.586952 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:53:47.588395 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-2397694b-3166-4f4c-9d6a-f59b1041c9a0 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Returning 404 to user: Instance c7578860-5e31-48e5-8a70-7c6bad9afe91 could not be found. {{(pid=118157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:53:47.588395 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-2397694b-3166-4f4c-9d6a-f59b1041c9a0 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "GET /compute/v2.1/servers/c7578860-5e31-48e5-8a70-7c6bad9afe91" status: 404 len: 111 microversion: 2.1 time: 0.032892 Jun 07 14:53:47.588395 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 607/1223] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:53:47 2022] GET /compute/v2.1/servers/c7578860-5e31-48e5-8a70-7c6bad9afe91 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 14:53:47.816935 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-0e9d2256-c7d5-4179-96b8-f55b7fe809b8 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:53:47.818377 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-0e9d2256-c7d5-4179-96b8-f55b7fe809b8 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] [instance: f56554dc-d349-4e0b-95b9-e86891387def] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:53:47.824826 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-0e9d2256-c7d5-4179-96b8-f55b7fe809b8 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:47.825281 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-0e9d2256-c7d5-4179-96b8-f55b7fe809b8 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:47.826050 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-0e9d2256-c7d5-4179-96b8-f55b7fe809b8 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:47.826489 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-0e9d2256-c7d5-4179-96b8-f55b7fe809b8 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:47.983623 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-0e9d2256-c7d5-4179-96b8-f55b7fe809b8 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7e40e0dfbf49a58d67b897f4792399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deac7502c4684bdcb5dd9151d6c09894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:53:47.991235 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-0e9d2256-c7d5-4179-96b8-f55b7fe809b8 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] 10.222.0.85 "GET /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def" status: 200 len: 1260 microversion: 2.1 time: 0.178491 Jun 07 14:53:47.991896 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 617/1224] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:53:47 2022] GET /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def => generated 1260 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:53:48.356912 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-8f5e4e6f-eecc-4222-a65c-9ebfe68da00c tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:53:48.357429 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-8f5e4e6f-eecc-4222-a65c-9ebfe68da00c tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: bac69e34-ec55-4f0b-8856-8411fe7ea17a] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:53:48.369381 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-8f5e4e6f-eecc-4222-a65c-9ebfe68da00c tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:48.369838 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-8f5e4e6f-eecc-4222-a65c-9ebfe68da00c tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:48.370634 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-8f5e4e6f-eecc-4222-a65c-9ebfe68da00c tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:48.371042 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-8f5e4e6f-eecc-4222-a65c-9ebfe68da00c tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:48.385388 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.wsgi [None req-8f5e4e6f-eecc-4222-a65c-9ebfe68da00c tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] HTTP exception thrown: Instance bac69e34-ec55-4f0b-8856-8411fe7ea17a could not be found. Jun 07 14:53:48.386953 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-8f5e4e6f-eecc-4222-a65c-9ebfe68da00c tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Request method failure captured: Jun 07 14:53:48.386953 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: request: DELETE /compute/v2.1/servers/bac69e34-ec55-4f0b-8856-8411fe7ea17a HTTP/1.1 Jun 07 14:53:48.386953 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Accept: application/json Jun 07 14:53:48.386953 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Accept-Encoding: identity Jun 07 14:53:48.386953 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Connection: close Jun 07 14:53:48.386953 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Content-Length: 0 Jun 07 14:53:48.386953 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Content-Type: application/json Jun 07 14:53:48.386953 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Host: 10.222.0.85 Jun 07 14:53:48.386953 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Openstack-System-Scope: None Jun 07 14:53:48.386953 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: User-Agent: python-urllib3/1.26.9 Jun 07 14:53:48.386953 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Auth-Token: gAAAAABin2PUqFwU0AvmOqgQNDY4J595fARbGRNudVshtvt4BECAbce2SeSyZ4ADP2Iau0xa-EhBJXaAKOTzJ6BR3V1eowASX2CJpSAhimVWcEo1dNqlj_TVzaqOJjEHBniJA_cMp1TlqS665UYoJ3dgIqGoQK7oDPSO8yRQ-fWSdwHmmcw0uR8 Jun 07 14:53:48.386953 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Domain-Id: None Jun 07 14:53:48.386953 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Domain-Name: None Jun 07 14:53:48.386953 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Identity-Status: Confirmed Jun 07 14:53:48.386953 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Is-Admin-Project: True Jun 07 14:53:48.386953 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Project-Domain-Id: default Jun 07 14:53:48.386953 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Project-Domain-Name: Default Jun 07 14:53:48.386953 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Project-Id: 93e877695d0f46339cb4b9b86aac3662 Jun 07 14:53:48.386953 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Project-Name: tempest-TestVolumeBootPattern-338121805 Jun 07 14:53:48.386953 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Role: member,reader Jun 07 14:53:48.386953 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Roles: member,reader Jun 07 14:53:48.388812 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/93e877695d0f46339cb4b9b86aac3662"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_93e877695d0f46339cb4b9b86aac3662"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/93e877695d0f46339cb4b9b86aac3662"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/93e877695d0f46339cb4b9b86aac3662"}]}] Jun 07 14:53:48.388812 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Tenant: tempest-TestVolumeBootPattern-338121805 Jun 07 14:53:48.388812 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Tenant-Id: 93e877695d0f46339cb4b9b86aac3662 Jun 07 14:53:48.388812 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Tenant-Name: tempest-TestVolumeBootPattern-338121805 Jun 07 14:53:48.388812 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User: tempest-TestVolumeBootPattern-338121805-project Jun 07 14:53:48.388812 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User-Domain-Id: default Jun 07 14:53:48.388812 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User-Domain-Name: Default Jun 07 14:53:48.388812 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User-Id: 0a15f5fa82414bdf8ca3f6723c0a8d2d Jun 07 14:53:48.388812 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User-Name: tempest-TestVolumeBootPattern-338121805-project Jun 07 14:53:48.388812 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: method: > Jun 07 14:53:48.388812 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: exception: Instance bac69e34-ec55-4f0b-8856-8411fe7ea17a could not be found. Jun 07 14:53:48.388812 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: action_args: {'id': 'bac69e34-ec55-4f0b-8856-8411fe7ea17a'} Jun 07 14:53:48.389842 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:53:48.389842 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:53:48.389842 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 14:53:48.389842 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 14:53:48.389842 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 14:53:48.389842 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 14:53:48.389842 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 14:53:48.389842 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 14:53:48.389842 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 14:53:48.389842 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 14:53:48.389842 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bac69e34-ec55-4f0b-8856-8411fe7ea17a could not be found. Jun 07 14:53:48.389842 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:53:48.389842 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:53:48.389842 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:53:48.389842 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:53:48.389842 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:53:48.389842 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:53:48.389842 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:53:48.389842 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:53:48.389842 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:53:48.391196 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:53:48.391196 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 07 14:53:48.391196 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 07 14:53:48.391196 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 07 14:53:48.391196 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 07 14:53:48.391196 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 14:53:48.391196 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 14:53:48.391196 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 14:53:48.391196 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:53:48.391196 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bac69e34-ec55-4f0b-8856-8411fe7ea17a could not be found. Jun 07 14:53:48.391196 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:53:48.391196 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:53:48.391196 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:53:48.391196 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:53:48.391196 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:53:48.391196 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:53:48.391196 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:53:48.391196 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:53:48.391196 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bac69e34-ec55-4f0b-8856-8411fe7ea17a could not be found. Jun 07 14:53:48.391196 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:53:48.392826 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-8f5e4e6f-eecc-4222-a65c-9ebfe68da00c tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Returning 404 to user: Instance bac69e34-ec55-4f0b-8856-8411fe7ea17a could not be found. {{(pid=118157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:53:48.392826 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-8f5e4e6f-eecc-4222-a65c-9ebfe68da00c tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "DELETE /compute/v2.1/servers/bac69e34-ec55-4f0b-8856-8411fe7ea17a" status: 404 len: 111 microversion: 2.1 time: 0.035416 Jun 07 14:53:48.392826 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 608/1225] 10.222.0.85 () {58 vars in 1238 bytes} [Tue Jun 7 14:53:48 2022] DELETE /compute/v2.1/servers/bac69e34-ec55-4f0b-8856-8411fe7ea17a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 14:53:48.397441 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-4ce04ad6-0e13-4e1c-a56d-46e0267217b1 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:53:48.398056 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-4ce04ad6-0e13-4e1c-a56d-46e0267217b1 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] [instance: bac69e34-ec55-4f0b-8856-8411fe7ea17a] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:53:48.404869 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-4ce04ad6-0e13-4e1c-a56d-46e0267217b1 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:48.405318 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-4ce04ad6-0e13-4e1c-a56d-46e0267217b1 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:48.406081 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-4ce04ad6-0e13-4e1c-a56d-46e0267217b1 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:48.406515 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-4ce04ad6-0e13-4e1c-a56d-46e0267217b1 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:48.419749 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.wsgi [None req-4ce04ad6-0e13-4e1c-a56d-46e0267217b1 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] HTTP exception thrown: Instance bac69e34-ec55-4f0b-8856-8411fe7ea17a could not be found. Jun 07 14:53:48.421407 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-4ce04ad6-0e13-4e1c-a56d-46e0267217b1 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Request method failure captured: Jun 07 14:53:48.421407 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: request: GET /compute/v2.1/servers/bac69e34-ec55-4f0b-8856-8411fe7ea17a HTTP/1.1 Jun 07 14:53:48.421407 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Accept: application/json Jun 07 14:53:48.421407 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Accept-Encoding: identity Jun 07 14:53:48.421407 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Connection: close Jun 07 14:53:48.421407 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Content-Length: 0 Jun 07 14:53:48.421407 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Content-Type: application/json Jun 07 14:53:48.421407 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Host: 10.222.0.85 Jun 07 14:53:48.421407 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Openstack-System-Scope: None Jun 07 14:53:48.421407 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: User-Agent: python-urllib3/1.26.9 Jun 07 14:53:48.421407 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Auth-Token: gAAAAABin2PUqFwU0AvmOqgQNDY4J595fARbGRNudVshtvt4BECAbce2SeSyZ4ADP2Iau0xa-EhBJXaAKOTzJ6BR3V1eowASX2CJpSAhimVWcEo1dNqlj_TVzaqOJjEHBniJA_cMp1TlqS665UYoJ3dgIqGoQK7oDPSO8yRQ-fWSdwHmmcw0uR8 Jun 07 14:53:48.421407 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Domain-Id: None Jun 07 14:53:48.421407 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Domain-Name: None Jun 07 14:53:48.421407 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Identity-Status: Confirmed Jun 07 14:53:48.421407 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Is-Admin-Project: True Jun 07 14:53:48.421407 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Domain-Id: default Jun 07 14:53:48.421407 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Domain-Name: Default Jun 07 14:53:48.421407 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Id: 93e877695d0f46339cb4b9b86aac3662 Jun 07 14:53:48.421407 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Name: tempest-TestVolumeBootPattern-338121805 Jun 07 14:53:48.421407 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Role: member,reader Jun 07 14:53:48.421407 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Roles: member,reader Jun 07 14:53:48.423111 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/93e877695d0f46339cb4b9b86aac3662"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_93e877695d0f46339cb4b9b86aac3662"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/93e877695d0f46339cb4b9b86aac3662"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/93e877695d0f46339cb4b9b86aac3662"}]}] Jun 07 14:53:48.423111 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Tenant: tempest-TestVolumeBootPattern-338121805 Jun 07 14:53:48.423111 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Tenant-Id: 93e877695d0f46339cb4b9b86aac3662 Jun 07 14:53:48.423111 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Tenant-Name: tempest-TestVolumeBootPattern-338121805 Jun 07 14:53:48.423111 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User: tempest-TestVolumeBootPattern-338121805-project Jun 07 14:53:48.423111 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Domain-Id: default Jun 07 14:53:48.423111 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Domain-Name: Default Jun 07 14:53:48.423111 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Id: 0a15f5fa82414bdf8ca3f6723c0a8d2d Jun 07 14:53:48.423111 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Name: tempest-TestVolumeBootPattern-338121805-project Jun 07 14:53:48.423111 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: method: > Jun 07 14:53:48.423111 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: exception: Instance bac69e34-ec55-4f0b-8856-8411fe7ea17a could not be found. Jun 07 14:53:48.423111 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: action_args: {'id': 'bac69e34-ec55-4f0b-8856-8411fe7ea17a'} Jun 07 14:53:48.424318 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:53:48.424318 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:53:48.424318 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 14:53:48.424318 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 14:53:48.424318 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 14:53:48.424318 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 14:53:48.424318 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 14:53:48.424318 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 14:53:48.424318 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 14:53:48.424318 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 14:53:48.424318 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bac69e34-ec55-4f0b-8856-8411fe7ea17a could not be found. Jun 07 14:53:48.424318 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:53:48.424318 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:53:48.424318 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:53:48.424318 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:53:48.424318 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:53:48.424318 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:53:48.424318 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:53:48.424318 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:53:48.424318 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:53:48.425976 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:53:48.425976 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 14:53:48.425976 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 14:53:48.425976 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 14:53:48.425976 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 14:53:48.425976 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 14:53:48.425976 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:53:48.425976 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bac69e34-ec55-4f0b-8856-8411fe7ea17a could not be found. Jun 07 14:53:48.425976 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:53:48.425976 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:53:48.425976 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:53:48.425976 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:53:48.425976 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:53:48.425976 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:53:48.425976 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:53:48.425976 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:53:48.425976 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bac69e34-ec55-4f0b-8856-8411fe7ea17a could not be found. Jun 07 14:53:48.425976 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:53:48.427537 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-4ce04ad6-0e13-4e1c-a56d-46e0267217b1 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Returning 404 to user: Instance bac69e34-ec55-4f0b-8856-8411fe7ea17a could not be found. {{(pid=118158) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:53:48.427537 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-4ce04ad6-0e13-4e1c-a56d-46e0267217b1 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "GET /compute/v2.1/servers/bac69e34-ec55-4f0b-8856-8411fe7ea17a" status: 404 len: 111 microversion: 2.1 time: 0.029708 Jun 07 14:53:48.427537 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 618/1226] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:53:48 2022] GET /compute/v2.1/servers/bac69e34-ec55-4f0b-8856-8411fe7ea17a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 14:53:49.009323 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-1cb93d9b-2efc-4294-83dc-f8f168df93b5 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:53:49.009939 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-1cb93d9b-2efc-4294-83dc-f8f168df93b5 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] [instance: f56554dc-d349-4e0b-95b9-e86891387def] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:53:49.011776 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG dbcounter [-] [118157] Writing DB stats nova_cell0:SELECT=2 {{(pid=118157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:53:49.016931 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-1cb93d9b-2efc-4294-83dc-f8f168df93b5 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:49.017423 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-1cb93d9b-2efc-4294-83dc-f8f168df93b5 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:49.018192 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-1cb93d9b-2efc-4294-83dc-f8f168df93b5 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:49.018647 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-1cb93d9b-2efc-4294-83dc-f8f168df93b5 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:49.150058 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-1cb93d9b-2efc-4294-83dc-f8f168df93b5 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7e40e0dfbf49a58d67b897f4792399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deac7502c4684bdcb5dd9151d6c09894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:53:49.157917 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-1cb93d9b-2efc-4294-83dc-f8f168df93b5 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] 10.222.0.85 "GET /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def" status: 200 len: 1260 microversion: 2.1 time: 0.153378 Jun 07 14:53:49.158485 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 609/1227] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:53:49 2022] GET /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:53:49.972358 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-32d45b0a-029d-4f28-b726-516465908639 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] Calling method '.version_select at 0x7f5f8815a040>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:53:49.972358 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG dbcounter [-] [118158] Writing DB stats nova_cell0:SELECT=2 {{(pid=118158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:53:50.078719 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-32d45b0a-029d-4f28-b726-516465908639 tempest-TestVolumeBootPattern-338121805 tempest-TestVolumeBootPattern-338121805-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1252179120" status: 202 len: 0 microversion: 2.1 time: 0.114563 Jun 07 14:53:50.079369 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 619/1228] 10.222.0.85 () {58 vars in 1262 bytes} [Tue Jun 7 14:53:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1252179120 => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 14:53:50.175043 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-5613f4a3-9bee-45e7-80a3-9565d9d801ad tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:53:50.175662 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-5613f4a3-9bee-45e7-80a3-9565d9d801ad tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] [instance: f56554dc-d349-4e0b-95b9-e86891387def] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:53:50.182366 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-5613f4a3-9bee-45e7-80a3-9565d9d801ad tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:50.183536 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-5613f4a3-9bee-45e7-80a3-9565d9d801ad tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:50.184245 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-5613f4a3-9bee-45e7-80a3-9565d9d801ad tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:50.184711 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-5613f4a3-9bee-45e7-80a3-9565d9d801ad tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:50.261550 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG dbcounter [-] [118157] Writing DB stats nova_cell0:SELECT=8 {{(pid=118157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:53:50.386888 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-5613f4a3-9bee-45e7-80a3-9565d9d801ad tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7e40e0dfbf49a58d67b897f4792399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deac7502c4684bdcb5dd9151d6c09894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:53:50.394547 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-5613f4a3-9bee-45e7-80a3-9565d9d801ad tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] 10.222.0.85 "GET /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def" status: 200 len: 1260 microversion: 2.1 time: 0.223395 Jun 07 14:53:50.395114 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 610/1229] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:53:50 2022] GET /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def => generated 1260 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:53:51.109513 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-cff4900d-4501-4ce7-8a85-fc830d3d6343 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1845075276"}} {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:53:51.110189 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-cff4900d-4501-4ce7-8a85-fc830d3d6343 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] [instance: 75e38ceb-ae6e-456f-968b-90e5f4f39d37] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:53:51.119053 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-cff4900d-4501-4ce7-8a85-fc830d3d6343 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:51.119763 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-cff4900d-4501-4ce7-8a85-fc830d3d6343 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:51.121449 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-cff4900d-4501-4ce7-8a85-fc830d3d6343 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:51.122214 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-cff4900d-4501-4ce7-8a85-fc830d3d6343 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:51.285090 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.network.security_group_api [None req-cff4900d-4501-4ce7-8a85-fc830d3d6343 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Removing security group 8790045f-6a34-42ba-8631-5ab6ccf433e8 from port 7b71f53f-1ebd-4fef-9f3d-7b046f3f3a49 Jun 07 14:53:51.419110 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-cb891e25-f178-42c3-ad62-75244349dc0b tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:53:51.420417 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-cb891e25-f178-42c3-ad62-75244349dc0b tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] [instance: f56554dc-d349-4e0b-95b9-e86891387def] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:53:51.429516 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-cb891e25-f178-42c3-ad62-75244349dc0b tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:51.430261 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-cb891e25-f178-42c3-ad62-75244349dc0b tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:51.431230 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-cb891e25-f178-42c3-ad62-75244349dc0b tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:51.431853 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-cb891e25-f178-42c3-ad62-75244349dc0b tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:51.717886 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-cb891e25-f178-42c3-ad62-75244349dc0b tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7e40e0dfbf49a58d67b897f4792399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deac7502c4684bdcb5dd9151d6c09894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:53:51.726476 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-cb891e25-f178-42c3-ad62-75244349dc0b tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] 10.222.0.85 "GET /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def" status: 200 len: 1260 microversion: 2.1 time: 0.318054 Jun 07 14:53:51.727315 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 611/1230] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:53:51 2022] GET /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def => generated 1260 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:53:51.878644 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-cff4900d-4501-4ce7-8a85-fc830d3d6343 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] 10.222.0.85 "POST /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37/action" status: 202 len: 0 microversion: 2.1 time: 0.906747 Jun 07 14:53:51.879150 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 620/1231] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Jun 7 14:53:50 2022] POST /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37/action => generated 0 bytes in 908 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 14:53:51.889526 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [req-eb879f6b-d56f-40fc-808a-81ef0b14f3e0 req-b0e1a7ae-b7eb-4ce1-92b1-712eb4ca9ecb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75e38ceb-ae6e-456f-968b-90e5f4f39d37", "tag": "7b71f53f-1ebd-4fef-9f3d-7b046f3f3a49"}]} {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:53:51.897018 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG dbcounter [-] [118157] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:53:51.899053 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [req-eb879f6b-d56f-40fc-808a-81ef0b14f3e0 req-b0e1a7ae-b7eb-4ce1-92b1-712eb4ca9ecb service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:51.899499 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [req-eb879f6b-d56f-40fc-808a-81ef0b14f3e0 req-b0e1a7ae-b7eb-4ce1-92b1-712eb4ca9ecb service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:51.918096 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.compute.server_external_events [req-eb879f6b-d56f-40fc-808a-81ef0b14f3e0 req-b0e1a7ae-b7eb-4ce1-92b1-712eb4ca9ecb service nova] Creating event network-changed:7b71f53f-1ebd-4fef-9f3d-7b046f3f3a49 for instance 75e38ceb-ae6e-456f-968b-90e5f4f39d37 on hv-cinder-84497 Jun 07 14:53:51.924609 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [req-eb879f6b-d56f-40fc-808a-81ef0b14f3e0 req-b0e1a7ae-b7eb-4ce1-92b1-712eb4ca9ecb service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038921 Jun 07 14:53:51.925753 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 612/1232] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jun 7 14:53:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:53:52.744265 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-772e3f32-e5ab-4f64-8035-227d04806efa tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:53:52.745189 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-772e3f32-e5ab-4f64-8035-227d04806efa tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] [instance: f56554dc-d349-4e0b-95b9-e86891387def] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:53:52.753789 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-772e3f32-e5ab-4f64-8035-227d04806efa tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:52.759577 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-772e3f32-e5ab-4f64-8035-227d04806efa tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:52.760809 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-772e3f32-e5ab-4f64-8035-227d04806efa tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:52.763882 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-772e3f32-e5ab-4f64-8035-227d04806efa tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:52.796107 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG dbcounter [-] [118158] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:53:52.999221 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-772e3f32-e5ab-4f64-8035-227d04806efa tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7e40e0dfbf49a58d67b897f4792399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deac7502c4684bdcb5dd9151d6c09894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:53:53.007002 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-772e3f32-e5ab-4f64-8035-227d04806efa tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] 10.222.0.85 "GET /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def" status: 200 len: 1260 microversion: 2.1 time: 0.267527 Jun 07 14:53:53.007554 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 621/1233] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:53:52 2022] GET /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def => generated 1260 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:53:53.633988 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-faec3f95-dd7e-4a74-b225-0fc5d602107e tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:53:53.634597 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-faec3f95-dd7e-4a74-b225-0fc5d602107e tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] [instance: 75e38ceb-ae6e-456f-968b-90e5f4f39d37] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:53:53.645290 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-faec3f95-dd7e-4a74-b225-0fc5d602107e tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:53.645779 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-faec3f95-dd7e-4a74-b225-0fc5d602107e tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:53.646581 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-faec3f95-dd7e-4a74-b225-0fc5d602107e tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:53.647017 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-faec3f95-dd7e-4a74-b225-0fc5d602107e tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:53.737121 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.objects.instance [None req-faec3f95-dd7e-4a74-b225-0fc5d602107e tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lazy-loading 'services' on Instance uuid 75e38ceb-ae6e-456f-968b-90e5f4f39d37 {{(pid=118157) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 14:53:53.945674 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [req-01a98572-6e57-4b44-b515-3218abd73384 req-5819bbac-b301-4c6d-9c57-914e2d1469fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75e38ceb-ae6e-456f-968b-90e5f4f39d37", "tag": "7b71f53f-1ebd-4fef-9f3d-7b046f3f3a49"}]} {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:53:53.965731 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-faec3f95-dd7e-4a74-b225-0fc5d602107e tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] 10.222.0.85 "DELETE /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37/os-volume_attachments/337782ec-525e-4e04-8c45-7fd8bfa4173b" status: 202 len: 0 microversion: 2.1 time: 0.332656 Jun 07 14:53:53.965731 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 613/1234] 10.222.0.85 () {58 vars in 1415 bytes} [Tue Jun 7 14:53:53 2022] DELETE /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37/os-volume_attachments/337782ec-525e-4e04-8c45-7fd8bfa4173b => generated 0 bytes in 334 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 14:53:53.974926 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [req-01a98572-6e57-4b44-b515-3218abd73384 req-5819bbac-b301-4c6d-9c57-914e2d1469fe service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:53.975368 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [req-01a98572-6e57-4b44-b515-3218abd73384 req-5819bbac-b301-4c6d-9c57-914e2d1469fe service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:53.978653 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-eaa1511d-9b15-4f20-b49e-27f947eeeebb tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:53:53.979602 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-eaa1511d-9b15-4f20-b49e-27f947eeeebb tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] [instance: 75e38ceb-ae6e-456f-968b-90e5f4f39d37] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:53:53.994406 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-eaa1511d-9b15-4f20-b49e-27f947eeeebb tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:53.994859 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-eaa1511d-9b15-4f20-b49e-27f947eeeebb tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:53.995647 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-eaa1511d-9b15-4f20-b49e-27f947eeeebb tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:53.996169 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-eaa1511d-9b15-4f20-b49e-27f947eeeebb tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:54.000773 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.compute.server_external_events [req-01a98572-6e57-4b44-b515-3218abd73384 req-5819bbac-b301-4c6d-9c57-914e2d1469fe service nova] Creating event network-changed:7b71f53f-1ebd-4fef-9f3d-7b046f3f3a49 for instance 75e38ceb-ae6e-456f-968b-90e5f4f39d37 on hv-cinder-84497 Jun 07 14:53:54.009638 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [req-01a98572-6e57-4b44-b515-3218abd73384 req-5819bbac-b301-4c6d-9c57-914e2d1469fe service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069539 Jun 07 14:53:54.010620 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 622/1235] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jun 7 14:53:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 14:53:54.042482 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-39ffff5b-1013-4889-ac41-bc23843a4203 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:53:54.042482 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-39ffff5b-1013-4889-ac41-bc23843a4203 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] [instance: f56554dc-d349-4e0b-95b9-e86891387def] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:53:54.046816 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-39ffff5b-1013-4889-ac41-bc23843a4203 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:54.047534 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-39ffff5b-1013-4889-ac41-bc23843a4203 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:54.048565 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-39ffff5b-1013-4889-ac41-bc23843a4203 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:54.049623 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-39ffff5b-1013-4889-ac41-bc23843a4203 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:54.084303 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-eaa1511d-9b15-4f20-b49e-27f947eeeebb tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] 10.222.0.85 "GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.111549 Jun 07 14:53:54.088538 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 614/1236] 10.222.0.85 () {58 vars in 1301 bytes} [Tue Jun 7 14:53:53 2022] GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:53:54.309861 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-39ffff5b-1013-4889-ac41-bc23843a4203 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7e40e0dfbf49a58d67b897f4792399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deac7502c4684bdcb5dd9151d6c09894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:53:54.318860 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-39ffff5b-1013-4889-ac41-bc23843a4203 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] 10.222.0.85 "GET /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def" status: 200 len: 1260 microversion: 2.1 time: 0.289107 Jun 07 14:53:54.320022 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 623/1237] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:53:54 2022] GET /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def => generated 1260 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:53:55.096137 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-75afc901-d6c0-4b1b-b639-b03ab3ce87fd tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:53:55.097229 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-75afc901-d6c0-4b1b-b639-b03ab3ce87fd tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] [instance: 75e38ceb-ae6e-456f-968b-90e5f4f39d37] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:53:55.104560 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-75afc901-d6c0-4b1b-b639-b03ab3ce87fd tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:55.105002 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-75afc901-d6c0-4b1b-b639-b03ab3ce87fd tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:55.105935 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-75afc901-d6c0-4b1b-b639-b03ab3ce87fd tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:55.106404 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-75afc901-d6c0-4b1b-b639-b03ab3ce87fd tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:55.137135 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-75afc901-d6c0-4b1b-b639-b03ab3ce87fd tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] 10.222.0.85 "GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044662 Jun 07 14:53:55.137891 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 615/1238] 10.222.0.85 () {58 vars in 1301 bytes} [Tue Jun 7 14:53:55 2022] GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:53:55.336481 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-e12be00e-83db-43bc-ad8a-a13642abfcd0 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:53:55.337222 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-e12be00e-83db-43bc-ad8a-a13642abfcd0 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] [instance: f56554dc-d349-4e0b-95b9-e86891387def] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:53:55.346599 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-e12be00e-83db-43bc-ad8a-a13642abfcd0 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:55.351772 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-e12be00e-83db-43bc-ad8a-a13642abfcd0 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:55.352936 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-e12be00e-83db-43bc-ad8a-a13642abfcd0 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:55.353381 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-e12be00e-83db-43bc-ad8a-a13642abfcd0 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:55.687055 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-e12be00e-83db-43bc-ad8a-a13642abfcd0 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7e40e0dfbf49a58d67b897f4792399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deac7502c4684bdcb5dd9151d6c09894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:53:55.695856 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-e12be00e-83db-43bc-ad8a-a13642abfcd0 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] 10.222.0.85 "GET /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def" status: 200 len: 1260 microversion: 2.1 time: 0.363534 Jun 07 14:53:55.696868 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 624/1239] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:53:55 2022] GET /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def => generated 1260 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:53:56.149222 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-1d865ba7-99a7-483c-9233-3d7803ff5c35 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:53:56.150154 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-1d865ba7-99a7-483c-9233-3d7803ff5c35 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] [instance: 75e38ceb-ae6e-456f-968b-90e5f4f39d37] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:53:56.156912 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-1d865ba7-99a7-483c-9233-3d7803ff5c35 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:56.157359 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-1d865ba7-99a7-483c-9233-3d7803ff5c35 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:56.158135 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-1d865ba7-99a7-483c-9233-3d7803ff5c35 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:56.158571 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-1d865ba7-99a7-483c-9233-3d7803ff5c35 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:56.193436 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-1d865ba7-99a7-483c-9233-3d7803ff5c35 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] 10.222.0.85 "GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042742 Jun 07 14:53:56.193436 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 616/1240] 10.222.0.85 () {58 vars in 1301 bytes} [Tue Jun 7 14:53:56 2022] GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 07 14:53:56.199480 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-5f23e259-2701-4b34-95d3-a3bb0e6de350 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:53:56.199955 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-5f23e259-2701-4b34-95d3-a3bb0e6de350 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] [instance: 75e38ceb-ae6e-456f-968b-90e5f4f39d37] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:53:56.206122 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5f23e259-2701-4b34-95d3-a3bb0e6de350 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:56.206572 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5f23e259-2701-4b34-95d3-a3bb0e6de350 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:56.207349 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5f23e259-2701-4b34-95d3-a3bb0e6de350 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:56.207784 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5f23e259-2701-4b34-95d3-a3bb0e6de350 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:56.283563 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.wsgi [None req-5f23e259-2701-4b34-95d3-a3bb0e6de350 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] HTTP exception thrown: Instance 75e38ceb-ae6e-456f-968b-90e5f4f39d37 is not attached to volume 337782ec-525e-4e04-8c45-7fd8bfa4173b Jun 07 14:53:56.295385 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-5f23e259-2701-4b34-95d3-a3bb0e6de350 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Request method failure captured: Jun 07 14:53:56.295385 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: request: DELETE /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37/os-volume_attachments/337782ec-525e-4e04-8c45-7fd8bfa4173b HTTP/1.1 Jun 07 14:53:56.295385 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Accept: application/json Jun 07 14:53:56.295385 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Accept-Encoding: identity Jun 07 14:53:56.295385 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Connection: close Jun 07 14:53:56.295385 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Content-Length: 0 Jun 07 14:53:56.295385 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Content-Type: application/json Jun 07 14:53:56.295385 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Host: 10.222.0.85 Jun 07 14:53:56.295385 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Openstack-System-Scope: None Jun 07 14:53:56.295385 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: User-Agent: python-urllib3/1.26.9 Jun 07 14:53:56.295385 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Auth-Token: gAAAAABin2VFY6cXm6LJ0KurJH--3OaO6_NZLVckVXuye1rkEUZzjFWPJ0Ke0vA1BLjy_13IxbF8cizUg_z05RBeTGw9DlleQOCLeY1ANCnN0A1QW_Rr4t0rwUS21QM6-ZqzTeXDpTZloqFvSJQeTGxoQR-z5n76dc4QMxxcZLk2PRlPLKN8FqU Jun 07 14:53:56.295385 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Domain-Id: None Jun 07 14:53:56.295385 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Domain-Name: None Jun 07 14:53:56.295385 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Identity-Status: Confirmed Jun 07 14:53:56.295385 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Is-Admin-Project: True Jun 07 14:53:56.295385 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Domain-Id: default Jun 07 14:53:56.295385 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Domain-Name: Default Jun 07 14:53:56.295385 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Id: 70b63567b3e54cf1a4348fb65b65a040 Jun 07 14:53:56.295385 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Name: tempest-TestMinimumBasicScenario-903294700 Jun 07 14:53:56.295385 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Role: member,reader Jun 07 14:53:56.295385 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Roles: member,reader Jun 07 14:53:56.297144 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/70b63567b3e54cf1a4348fb65b65a040"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_70b63567b3e54cf1a4348fb65b65a040"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/70b63567b3e54cf1a4348fb65b65a040"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/70b63567b3e54cf1a4348fb65b65a040"}]}] Jun 07 14:53:56.297144 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Tenant: tempest-TestMinimumBasicScenario-903294700 Jun 07 14:53:56.297144 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Tenant-Id: 70b63567b3e54cf1a4348fb65b65a040 Jun 07 14:53:56.297144 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Tenant-Name: tempest-TestMinimumBasicScenario-903294700 Jun 07 14:53:56.297144 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User: tempest-TestMinimumBasicScenario-903294700-project Jun 07 14:53:56.297144 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Domain-Id: default Jun 07 14:53:56.297144 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Domain-Name: Default Jun 07 14:53:56.297144 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Id: f2b3f5c080034b658cbfb311c0c77b26 Jun 07 14:53:56.297144 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Name: tempest-TestMinimumBasicScenario-903294700-project Jun 07 14:53:56.297144 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: method: > Jun 07 14:53:56.297144 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: exception: Instance 75e38ceb-ae6e-456f-968b-90e5f4f39d37 is not attached to volume 337782ec-525e-4e04-8c45-7fd8bfa4173b Jun 07 14:53:56.298056 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: action_args: {'server_id': '75e38ceb-ae6e-456f-968b-90e5f4f39d37', 'id': '337782ec-525e-4e04-8c45-7fd8bfa4173b'} Jun 07 14:53:56.298056 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:53:56.298056 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:53:56.298056 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 07 14:53:56.298056 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 07 14:53:56.298056 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 07 14:53:56.298056 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 07 14:53:56.298056 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 07 14:53:56.298056 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 07 14:53:56.298056 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 337782ec-525e-4e04-8c45-7fd8bfa4173b. Jun 07 14:53:56.298056 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:53:56.298056 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:53:56.298056 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:53:56.298056 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:53:56.298056 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:53:56.298056 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:53:56.298056 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:53:56.298056 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:53:56.298056 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:53:56.299583 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:53:56.299583 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 07 14:53:56.299583 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 07 14:53:56.299583 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75e38ceb-ae6e-456f-968b-90e5f4f39d37 is not attached to volume 337782ec-525e-4e04-8c45-7fd8bfa4173b Jun 07 14:53:56.299583 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:53:56.299583 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:53:56.299583 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:53:56.299583 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:53:56.299583 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:53:56.299583 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:53:56.299583 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:53:56.299583 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:53:56.299583 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75e38ceb-ae6e-456f-968b-90e5f4f39d37 is not attached to volume 337782ec-525e-4e04-8c45-7fd8bfa4173b Jun 07 14:53:56.299583 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:53:56.299583 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-5f23e259-2701-4b34-95d3-a3bb0e6de350 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Returning 404 to user: Instance 75e38ceb-ae6e-456f-968b-90e5f4f39d37 is not attached to volume 337782ec-525e-4e04-8c45-7fd8bfa4173b {{(pid=118158) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:53:56.300776 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-5f23e259-2701-4b34-95d3-a3bb0e6de350 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] 10.222.0.85 "DELETE /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37/os-volume_attachments/337782ec-525e-4e04-8c45-7fd8bfa4173b" status: 404 len: 154 microversion: 2.1 time: 0.101668 Jun 07 14:53:56.300776 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 625/1241] 10.222.0.85 () {58 vars in 1415 bytes} [Tue Jun 7 14:53:56 2022] DELETE /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37/os-volume_attachments/337782ec-525e-4e04-8c45-7fd8bfa4173b => generated 154 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 14:53:56.713851 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-bd2ba6cc-26b6-46e2-9875-51ad58a43cfa tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:53:56.714671 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-bd2ba6cc-26b6-46e2-9875-51ad58a43cfa tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] [instance: f56554dc-d349-4e0b-95b9-e86891387def] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:53:56.721498 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-bd2ba6cc-26b6-46e2-9875-51ad58a43cfa tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:56.721947 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-bd2ba6cc-26b6-46e2-9875-51ad58a43cfa tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:56.722996 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-bd2ba6cc-26b6-46e2-9875-51ad58a43cfa tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:56.723616 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-bd2ba6cc-26b6-46e2-9875-51ad58a43cfa tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:56.810781 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [req-7d6c96bd-3251-49f3-a91f-a1d889f8742f req-121eda63-f8ea-427e-906f-0b44eb671ec7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f56554dc-d349-4e0b-95b9-e86891387def", "name": "network-vif-plugged", "status": "completed", "tag": "114b12fc-435d-466d-bf5f-18df5b6bc051"}]} {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:53:56.822511 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [req-7d6c96bd-3251-49f3-a91f-a1d889f8742f req-121eda63-f8ea-427e-906f-0b44eb671ec7 service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:56.823426 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [req-7d6c96bd-3251-49f3-a91f-a1d889f8742f req-121eda63-f8ea-427e-906f-0b44eb671ec7 service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:56.837154 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.compute.server_external_events [req-7d6c96bd-3251-49f3-a91f-a1d889f8742f req-121eda63-f8ea-427e-906f-0b44eb671ec7 service nova] Creating event network-vif-plugged:114b12fc-435d-466d-bf5f-18df5b6bc051 for instance f56554dc-d349-4e0b-95b9-e86891387def on hv-cinder-84497 Jun 07 14:53:56.842852 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [req-7d6c96bd-3251-49f3-a91f-a1d889f8742f req-121eda63-f8ea-427e-906f-0b44eb671ec7 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035766 Jun 07 14:53:56.845662 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 626/1242] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jun 7 14:53:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 14:53:56.891041 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-bd2ba6cc-26b6-46e2-9875-51ad58a43cfa tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7e40e0dfbf49a58d67b897f4792399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deac7502c4684bdcb5dd9151d6c09894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:53:56.900533 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-bd2ba6cc-26b6-46e2-9875-51ad58a43cfa tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] 10.222.0.85 "GET /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def" status: 200 len: 1260 microversion: 2.1 time: 0.189759 Jun 07 14:53:56.900533 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 617/1243] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:53:56 2022] GET /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def => generated 1260 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:53:57.580463 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-c0783935-2924-4323-8726-5cf0f8d4b2e8 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:53:57.581086 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-c0783935-2924-4323-8726-5cf0f8d4b2e8 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] [instance: 75e38ceb-ae6e-456f-968b-90e5f4f39d37] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:53:57.587835 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-c0783935-2924-4323-8726-5cf0f8d4b2e8 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:57.588287 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-c0783935-2924-4323-8726-5cf0f8d4b2e8 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:57.589077 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-c0783935-2924-4323-8726-5cf0f8d4b2e8 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:57.589557 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-c0783935-2924-4323-8726-5cf0f8d4b2e8 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:57.615890 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-c0783935-2924-4323-8726-5cf0f8d4b2e8 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] [instance: 75e38ceb-ae6e-456f-968b-90e5f4f39d37] Going to try to terminate instance {{(pid=118158) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 14:53:57.917893 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-49148878-b409-48a4-bd81-c659b0c5d139 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:53:57.920295 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-49148878-b409-48a4-bd81-c659b0c5d139 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] [instance: f56554dc-d349-4e0b-95b9-e86891387def] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:53:57.927256 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-49148878-b409-48a4-bd81-c659b0c5d139 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:57.927707 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-49148878-b409-48a4-bd81-c659b0c5d139 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:57.928854 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-49148878-b409-48a4-bd81-c659b0c5d139 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:57.932145 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-c0783935-2924-4323-8726-5cf0f8d4b2e8 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] 10.222.0.85 "DELETE /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37" status: 204 len: 0 microversion: 2.1 time: 0.355643 Jun 07 14:53:57.932870 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 627/1244] 10.222.0.85 () {58 vars in 1238 bytes} [Tue Jun 7 14:53:57 2022] DELETE /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 14:53:57.933669 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-49148878-b409-48a4-bd81-c659b0c5d139 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:57.947184 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-b586c866-4a11-4534-8380-541557ce64a5 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:53:57.947986 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-b586c866-4a11-4534-8380-541557ce64a5 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] [instance: 75e38ceb-ae6e-456f-968b-90e5f4f39d37] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:53:57.955356 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-b586c866-4a11-4534-8380-541557ce64a5 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:57.956124 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-b586c866-4a11-4534-8380-541557ce64a5 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:57.957188 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-b586c866-4a11-4534-8380-541557ce64a5 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:57.958200 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-b586c866-4a11-4534-8380-541557ce64a5 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:58.114283 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-b586c866-4a11-4534-8380-541557ce64a5 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b3f5c080034b658cbfb311c0c77b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b63567b3e54cf1a4348fb65b65a040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:53:58.122558 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-b586c866-4a11-4534-8380-541557ce64a5 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] 10.222.0.85 "GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37" status: 200 len: 1556 microversion: 2.1 time: 0.180202 Jun 07 14:53:58.123131 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 628/1245] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:53:57 2022] GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37 => generated 1556 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:53:58.181165 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-49148878-b409-48a4-bd81-c659b0c5d139 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7e40e0dfbf49a58d67b897f4792399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deac7502c4684bdcb5dd9151d6c09894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:53:58.188996 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-49148878-b409-48a4-bd81-c659b0c5d139 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] 10.222.0.85 "GET /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def" status: 200 len: 1260 microversion: 2.1 time: 0.275561 Jun 07 14:53:58.189545 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 618/1246] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:53:57 2022] GET /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def => generated 1260 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:53:59.140191 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-ac2e99d4-f6da-48df-8b04-e5e095ed6837 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:53:59.141609 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-ac2e99d4-f6da-48df-8b04-e5e095ed6837 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] [instance: 75e38ceb-ae6e-456f-968b-90e5f4f39d37] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:53:59.147529 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-ac2e99d4-f6da-48df-8b04-e5e095ed6837 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:59.147975 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-ac2e99d4-f6da-48df-8b04-e5e095ed6837 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:59.148823 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-ac2e99d4-f6da-48df-8b04-e5e095ed6837 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:59.149259 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-ac2e99d4-f6da-48df-8b04-e5e095ed6837 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:59.206768 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-ff15d9fe-9de0-4e1e-9354-59baea745196 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:53:59.207490 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-ff15d9fe-9de0-4e1e-9354-59baea745196 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] [instance: f56554dc-d349-4e0b-95b9-e86891387def] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:53:59.216590 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-ff15d9fe-9de0-4e1e-9354-59baea745196 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:59.217041 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-ff15d9fe-9de0-4e1e-9354-59baea745196 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:59.217950 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-ff15d9fe-9de0-4e1e-9354-59baea745196 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:53:59.218343 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-ff15d9fe-9de0-4e1e-9354-59baea745196 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:53:59.283095 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-ac2e99d4-f6da-48df-8b04-e5e095ed6837 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b3f5c080034b658cbfb311c0c77b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b63567b3e54cf1a4348fb65b65a040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:53:59.291417 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-ac2e99d4-f6da-48df-8b04-e5e095ed6837 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] 10.222.0.85 "GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37" status: 200 len: 1556 microversion: 2.1 time: 0.154959 Jun 07 14:53:59.292000 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 629/1247] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:53:59 2022] GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37 => generated 1556 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:53:59.358499 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-ff15d9fe-9de0-4e1e-9354-59baea745196 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7e40e0dfbf49a58d67b897f4792399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deac7502c4684bdcb5dd9151d6c09894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:53:59.366163 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-ff15d9fe-9de0-4e1e-9354-59baea745196 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] 10.222.0.85 "GET /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def" status: 200 len: 1260 microversion: 2.1 time: 0.164048 Jun 07 14:53:59.366811 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 619/1248] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:53:59 2022] GET /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:54:00.308332 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-b281a24b-5595-4d37-bdfd-6d46ce4fac66 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:54:00.308981 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-b281a24b-5595-4d37-bdfd-6d46ce4fac66 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] [instance: 75e38ceb-ae6e-456f-968b-90e5f4f39d37] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:54:00.315408 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-b281a24b-5595-4d37-bdfd-6d46ce4fac66 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:54:00.315872 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-b281a24b-5595-4d37-bdfd-6d46ce4fac66 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:54:00.316659 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-b281a24b-5595-4d37-bdfd-6d46ce4fac66 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:54:00.317101 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-b281a24b-5595-4d37-bdfd-6d46ce4fac66 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:54:00.384119 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-c301e8b8-5889-4a61-80ba-5fe35da8d2cd tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:54:00.384737 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-c301e8b8-5889-4a61-80ba-5fe35da8d2cd tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] [instance: f56554dc-d349-4e0b-95b9-e86891387def] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:54:00.391772 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-c301e8b8-5889-4a61-80ba-5fe35da8d2cd tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:54:00.392228 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-c301e8b8-5889-4a61-80ba-5fe35da8d2cd tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:54:00.393097 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-c301e8b8-5889-4a61-80ba-5fe35da8d2cd tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:54:00.393544 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-c301e8b8-5889-4a61-80ba-5fe35da8d2cd tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:54:00.537372 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-c301e8b8-5889-4a61-80ba-5fe35da8d2cd tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7e40e0dfbf49a58d67b897f4792399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deac7502c4684bdcb5dd9151d6c09894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:54:00.545659 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-c301e8b8-5889-4a61-80ba-5fe35da8d2cd tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] 10.222.0.85 "GET /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def" status: 200 len: 1444 microversion: 2.1 time: 0.166383 Jun 07 14:54:00.548988 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-b281a24b-5595-4d37-bdfd-6d46ce4fac66 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b3f5c080034b658cbfb311c0c77b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b63567b3e54cf1a4348fb65b65a040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:54:00.560659 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-b281a24b-5595-4d37-bdfd-6d46ce4fac66 tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] 10.222.0.85 "GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37" status: 200 len: 1556 microversion: 2.1 time: 0.252791 Jun 07 14:54:00.560659 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 630/1249] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:54:00 2022] GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37 => generated 1556 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:54:00.561278 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 620/1250] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:54:00 2022] GET /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def => generated 1444 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:54:00.570944 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-5e39faa5-b88b-4108-b67a-cead15178b6b tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:54:00.571819 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-5e39faa5-b88b-4108-b67a-cead15178b6b tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] [instance: f56554dc-d349-4e0b-95b9-e86891387def] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:54:00.578498 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5e39faa5-b88b-4108-b67a-cead15178b6b tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:54:00.578951 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5e39faa5-b88b-4108-b67a-cead15178b6b tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:54:00.579740 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5e39faa5-b88b-4108-b67a-cead15178b6b tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:54:00.580185 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-5e39faa5-b88b-4108-b67a-cead15178b6b tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:54:00.857846 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-5e39faa5-b88b-4108-b67a-cead15178b6b tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7e40e0dfbf49a58d67b897f4792399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deac7502c4684bdcb5dd9151d6c09894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:54:00.866840 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-5e39faa5-b88b-4108-b67a-cead15178b6b tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] 10.222.0.85 "GET /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def" status: 200 len: 1444 microversion: 2.1 time: 0.301206 Jun 07 14:54:00.867789 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 631/1251] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:54:00 2022] GET /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def => generated 1444 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:54:01.162902 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [req-841ad016-53c0-46c3-befe-a27ac36fc244 req-0cf0f933-339a-4f00-b9a6-8613554bd5ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75e38ceb-ae6e-456f-968b-90e5f4f39d37", "name": "network-vif-deleted", "tag": "7b71f53f-1ebd-4fef-9f3d-7b046f3f3a49"}]} {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:54:01.174735 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [req-841ad016-53c0-46c3-befe-a27ac36fc244 req-0cf0f933-339a-4f00-b9a6-8613554bd5ba service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:54:01.175407 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [req-841ad016-53c0-46c3-befe-a27ac36fc244 req-0cf0f933-339a-4f00-b9a6-8613554bd5ba service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:54:01.193545 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.compute.server_external_events [req-841ad016-53c0-46c3-befe-a27ac36fc244 req-0cf0f933-339a-4f00-b9a6-8613554bd5ba service nova] Creating event network-vif-deleted:7b71f53f-1ebd-4fef-9f3d-7b046f3f3a49 for instance 75e38ceb-ae6e-456f-968b-90e5f4f39d37 on hv-cinder-84497 Jun 07 14:54:01.202653 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [req-841ad016-53c0-46c3-befe-a27ac36fc244 req-0cf0f933-339a-4f00-b9a6-8613554bd5ba service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046231 Jun 07 14:54:01.203193 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 621/1252] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jun 7 14:54:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:54:01.574390 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-e49c2ef0-a944-4170-a94b-98d268c3e2fb tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:54:01.575430 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-e49c2ef0-a944-4170-a94b-98d268c3e2fb tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] [instance: 75e38ceb-ae6e-456f-968b-90e5f4f39d37] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:54:01.581749 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-e49c2ef0-a944-4170-a94b-98d268c3e2fb tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:54:01.582192 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-e49c2ef0-a944-4170-a94b-98d268c3e2fb tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:54:01.582968 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-e49c2ef0-a944-4170-a94b-98d268c3e2fb tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:54:01.583935 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-e49c2ef0-a944-4170-a94b-98d268c3e2fb tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:54:01.615846 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-e49c2ef0-a944-4170-a94b-98d268c3e2fb tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:54:01.616296 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-e49c2ef0-a944-4170-a94b-98d268c3e2fb tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:54:01.616807 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.objects.instance [None req-e49c2ef0-a944-4170-a94b-98d268c3e2fb tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lazy-loading 'fault' on Instance uuid 75e38ceb-ae6e-456f-968b-90e5f4f39d37 {{(pid=118158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 14:54:01.662317 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-e49c2ef0-a944-4170-a94b-98d268c3e2fb tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b3f5c080034b658cbfb311c0c77b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b63567b3e54cf1a4348fb65b65a040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:54:01.670700 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-e49c2ef0-a944-4170-a94b-98d268c3e2fb tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] 10.222.0.85 "GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37" status: 200 len: 1349 microversion: 2.1 time: 0.100082 Jun 07 14:54:01.671189 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 632/1253] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:54:01 2022] GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37 => generated 1349 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:54:02.695645 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-4d506298-47cb-49e7-a3f2-113ef9741faa tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:54:02.696355 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-4d506298-47cb-49e7-a3f2-113ef9741faa tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] [instance: 75e38ceb-ae6e-456f-968b-90e5f4f39d37] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:54:02.702631 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-4d506298-47cb-49e7-a3f2-113ef9741faa tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:54:02.703119 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-4d506298-47cb-49e7-a3f2-113ef9741faa tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:54:02.703897 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-4d506298-47cb-49e7-a3f2-113ef9741faa tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:54:02.704336 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-4d506298-47cb-49e7-a3f2-113ef9741faa tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:54:02.717850 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.wsgi [None req-4d506298-47cb-49e7-a3f2-113ef9741faa tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] HTTP exception thrown: Instance 75e38ceb-ae6e-456f-968b-90e5f4f39d37 could not be found. Jun 07 14:54:02.719530 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-4d506298-47cb-49e7-a3f2-113ef9741faa tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Request method failure captured: Jun 07 14:54:02.719530 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: request: GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37 HTTP/1.1 Jun 07 14:54:02.719530 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Accept: application/json Jun 07 14:54:02.719530 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Accept-Encoding: identity Jun 07 14:54:02.719530 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Connection: close Jun 07 14:54:02.719530 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Content-Length: 0 Jun 07 14:54:02.719530 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Content-Type: application/json Jun 07 14:54:02.719530 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Host: 10.222.0.85 Jun 07 14:54:02.719530 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Openstack-System-Scope: None Jun 07 14:54:02.719530 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: User-Agent: python-urllib3/1.26.9 Jun 07 14:54:02.719530 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Auth-Token: gAAAAABin2VFY6cXm6LJ0KurJH--3OaO6_NZLVckVXuye1rkEUZzjFWPJ0Ke0vA1BLjy_13IxbF8cizUg_z05RBeTGw9DlleQOCLeY1ANCnN0A1QW_Rr4t0rwUS21QM6-ZqzTeXDpTZloqFvSJQeTGxoQR-z5n76dc4QMxxcZLk2PRlPLKN8FqU Jun 07 14:54:02.719530 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Domain-Id: None Jun 07 14:54:02.719530 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Domain-Name: None Jun 07 14:54:02.719530 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Identity-Status: Confirmed Jun 07 14:54:02.719530 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Is-Admin-Project: True Jun 07 14:54:02.719530 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Project-Domain-Id: default Jun 07 14:54:02.719530 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Project-Domain-Name: Default Jun 07 14:54:02.719530 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Project-Id: 70b63567b3e54cf1a4348fb65b65a040 Jun 07 14:54:02.719530 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Project-Name: tempest-TestMinimumBasicScenario-903294700 Jun 07 14:54:02.719530 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Role: member,reader Jun 07 14:54:02.719530 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Roles: member,reader Jun 07 14:54:02.721201 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/70b63567b3e54cf1a4348fb65b65a040"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_70b63567b3e54cf1a4348fb65b65a040"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/70b63567b3e54cf1a4348fb65b65a040"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/70b63567b3e54cf1a4348fb65b65a040"}]}] Jun 07 14:54:02.721201 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Tenant: tempest-TestMinimumBasicScenario-903294700 Jun 07 14:54:02.721201 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Tenant-Id: 70b63567b3e54cf1a4348fb65b65a040 Jun 07 14:54:02.721201 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-Tenant-Name: tempest-TestMinimumBasicScenario-903294700 Jun 07 14:54:02.721201 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User: tempest-TestMinimumBasicScenario-903294700-project Jun 07 14:54:02.721201 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User-Domain-Id: default Jun 07 14:54:02.721201 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User-Domain-Name: Default Jun 07 14:54:02.721201 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User-Id: f2b3f5c080034b658cbfb311c0c77b26 Jun 07 14:54:02.721201 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: X-User-Name: tempest-TestMinimumBasicScenario-903294700-project Jun 07 14:54:02.721201 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: method: > Jun 07 14:54:02.721201 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: exception: Instance 75e38ceb-ae6e-456f-968b-90e5f4f39d37 could not be found. Jun 07 14:54:02.721201 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: action_args: {'id': '75e38ceb-ae6e-456f-968b-90e5f4f39d37'} Jun 07 14:54:02.725732 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:54:02.725732 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:54:02.725732 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 14:54:02.725732 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 14:54:02.725732 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 14:54:02.725732 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 14:54:02.725732 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 14:54:02.725732 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 14:54:02.725732 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 14:54:02.725732 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 14:54:02.725732 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75e38ceb-ae6e-456f-968b-90e5f4f39d37 could not be found. Jun 07 14:54:02.725732 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:54:02.725732 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:54:02.725732 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:54:02.725732 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:54:02.725732 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:54:02.725732 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:54:02.725732 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:54:02.725732 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:54:02.725732 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:54:02.727387 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:54:02.727387 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 14:54:02.727387 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 14:54:02.727387 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 14:54:02.727387 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 14:54:02.727387 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 14:54:02.727387 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:54:02.727387 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75e38ceb-ae6e-456f-968b-90e5f4f39d37 could not be found. Jun 07 14:54:02.727387 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:54:02.727387 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:54:02.727387 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:54:02.727387 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:54:02.727387 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:54:02.727387 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:54:02.727387 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:54:02.727387 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:54:02.727387 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75e38ceb-ae6e-456f-968b-90e5f4f39d37 could not be found. Jun 07 14:54:02.727387 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR nova.api.openstack.wsgi Jun 07 14:54:02.728867 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-4d506298-47cb-49e7-a3f2-113ef9741faa tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Returning 404 to user: Instance 75e38ceb-ae6e-456f-968b-90e5f4f39d37 could not be found. {{(pid=118157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:54:02.728867 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-4d506298-47cb-49e7-a3f2-113ef9741faa tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] 10.222.0.85 "GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37" status: 404 len: 111 microversion: 2.1 time: 0.030285 Jun 07 14:54:02.728867 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 622/1254] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:54:02 2022] GET /compute/v2.1/servers/75e38ceb-ae6e-456f-968b-90e5f4f39d37 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 14:54:02.730023 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-81e2f57d-61c8-40c2-bb07-c647dd0c805d tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] Calling method '.version_select at 0x7f5f8c1965e0>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:54:02.798742 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-81e2f57d-61c8-40c2-bb07-c647dd0c805d tempest-TestMinimumBasicScenario-903294700 tempest-TestMinimumBasicScenario-903294700-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1270995629" status: 202 len: 0 microversion: 2.1 time: 0.072381 Jun 07 14:54:02.799353 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 633/1255] 10.222.0.85 () {58 vars in 1271 bytes} [Tue Jun 7 14:54:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1270995629 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 07 14:54:03.083948 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [req-56e9b83e-57b9-4d02-ab00-d32ac68eb09d req-d2146f9d-51db-4fdd-ad6b-6a349fe45565 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f56554dc-d349-4e0b-95b9-e86891387def", "tag": "114b12fc-435d-466d-bf5f-18df5b6bc051"}]} {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:54:03.092168 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [req-56e9b83e-57b9-4d02-ab00-d32ac68eb09d req-d2146f9d-51db-4fdd-ad6b-6a349fe45565 service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:54:03.092647 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [req-56e9b83e-57b9-4d02-ab00-d32ac68eb09d req-d2146f9d-51db-4fdd-ad6b-6a349fe45565 service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:54:03.104644 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.compute.server_external_events [req-56e9b83e-57b9-4d02-ab00-d32ac68eb09d req-d2146f9d-51db-4fdd-ad6b-6a349fe45565 service nova] Creating event network-changed:114b12fc-435d-466d-bf5f-18df5b6bc051 for instance f56554dc-d349-4e0b-95b9-e86891387def on hv-cinder-84497 Jun 07 14:54:03.109496 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [req-56e9b83e-57b9-4d02-ab00-d32ac68eb09d req-d2146f9d-51db-4fdd-ad6b-6a349fe45565 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029765 Jun 07 14:54:03.110077 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 623/1256] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jun 7 14:54:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:54:40.046788 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 14:54:40.047416 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Tue Jun 7 14:54:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 07 14:56:17.245184 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR oslo.messaging._drivers.impl_rabbit [-] [94207c62-b03b-46b5-a676-11becad6a69a] AMQP server on 10.222.0.85:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 07 14:56:17.245855 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG dbcounter [-] [118158] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:56:17.246557 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG dbcounter [-] [118158] Writing DB stats nova_api:SELECT=50,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=118158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:56:17.250920 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-0c197ce0-84e1-44f9-845d-715ba5f40793 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:56:17.251458 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-0c197ce0-84e1-44f9-845d-715ba5f40793 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] [instance: f56554dc-d349-4e0b-95b9-e86891387def] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:56:17.257988 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-0c197ce0-84e1-44f9-845d-715ba5f40793 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:56:17.263395 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-0c197ce0-84e1-44f9-845d-715ba5f40793 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:56:17.263395 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-0c197ce0-84e1-44f9-845d-715ba5f40793 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:56:17.263395 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-0c197ce0-84e1-44f9-845d-715ba5f40793 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:56:17.282497 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.objects.instance [None req-0c197ce0-84e1-44f9-845d-715ba5f40793 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lazy-loading 'flavor' on Instance uuid f56554dc-d349-4e0b-95b9-e86891387def {{(pid=118158) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 14:56:17.507043 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-0c197ce0-84e1-44f9-845d-715ba5f40793 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] 10.222.0.85 "POST /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def/action" status: 202 len: 0 microversion: 2.1 time: 0.264299 Jun 07 14:56:17.507545 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 634/1257] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Jun 7 14:56:17 2022] POST /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def/action => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 14:56:17.515073 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3950a0e2-6a04-4dfe-9c59-79f5a7bdf72b] AMQP server on 10.222.0.85:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 07 14:56:17.515873 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG dbcounter [-] [118157] Writing DB stats nova_api:SELECT=23 {{(pid=118157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:56:17.517012 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG dbcounter [-] [118157] Writing DB stats nova_cell1:SELECT=82,nova_cell1:INSERT=1 {{(pid=118157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:56:17.522878 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-a2955092-0d80-42aa-9a17-8219d457d41b tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:56:17.523679 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-a2955092-0d80-42aa-9a17-8219d457d41b tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] [instance: f56554dc-d349-4e0b-95b9-e86891387def] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:56:17.530869 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-a2955092-0d80-42aa-9a17-8219d457d41b tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:56:17.533053 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-a2955092-0d80-42aa-9a17-8219d457d41b tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:56:17.533053 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-a2955092-0d80-42aa-9a17-8219d457d41b tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:56:17.533053 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-a2955092-0d80-42aa-9a17-8219d457d41b tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:56:17.790379 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-a2955092-0d80-42aa-9a17-8219d457d41b tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7e40e0dfbf49a58d67b897f4792399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deac7502c4684bdcb5dd9151d6c09894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:56:17.798087 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-a2955092-0d80-42aa-9a17-8219d457d41b tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] 10.222.0.85 "GET /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def" status: 200 len: 1569 microversion: 2.1 time: 0.285441 Jun 07 14:56:17.798644 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 624/1258] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:56:17 2022] GET /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def => generated 1569 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:56:18.815865 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-48d52c68-7209-43d8-a2eb-eb8de98c6426 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:56:18.816516 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-48d52c68-7209-43d8-a2eb-eb8de98c6426 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] [instance: f56554dc-d349-4e0b-95b9-e86891387def] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:56:18.826133 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-48d52c68-7209-43d8-a2eb-eb8de98c6426 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:56:18.826738 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-48d52c68-7209-43d8-a2eb-eb8de98c6426 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:56:18.827627 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-48d52c68-7209-43d8-a2eb-eb8de98c6426 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:56:18.828074 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-48d52c68-7209-43d8-a2eb-eb8de98c6426 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:56:18.833886 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO oslo.messaging._drivers.impl_rabbit [-] [94207c62-b03b-46b5-a676-11becad6a69a] Reconnected to AMQP server on 10.222.0.85:5672 via [amqp] client with port 37404. Jun 07 14:56:19.020392 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-48d52c68-7209-43d8-a2eb-eb8de98c6426 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7e40e0dfbf49a58d67b897f4792399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deac7502c4684bdcb5dd9151d6c09894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:56:19.027999 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-48d52c68-7209-43d8-a2eb-eb8de98c6426 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] 10.222.0.85 "GET /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def" status: 200 len: 1569 microversion: 2.1 time: 0.216571 Jun 07 14:56:19.028587 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 635/1259] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:56:18 2022] GET /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def => generated 1569 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:56:20.045896 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-1dc65faa-a088-4546-a565-0542c4031bcf tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:56:20.046477 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-1dc65faa-a088-4546-a565-0542c4031bcf tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] [instance: f56554dc-d349-4e0b-95b9-e86891387def] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:56:20.053698 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-1dc65faa-a088-4546-a565-0542c4031bcf tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:56:20.054152 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-1dc65faa-a088-4546-a565-0542c4031bcf tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:56:20.054929 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-1dc65faa-a088-4546-a565-0542c4031bcf tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:56:20.055370 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-1dc65faa-a088-4546-a565-0542c4031bcf tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:56:20.061306 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO oslo.messaging._drivers.impl_rabbit [-] [3950a0e2-6a04-4dfe-9c59-79f5a7bdf72b] Reconnected to AMQP server on 10.222.0.85:5672 via [amqp] client with port 37410. Jun 07 14:56:20.191195 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-1dc65faa-a088-4546-a565-0542c4031bcf tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7e40e0dfbf49a58d67b897f4792399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deac7502c4684bdcb5dd9151d6c09894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:56:20.199390 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-1dc65faa-a088-4546-a565-0542c4031bcf tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] 10.222.0.85 "GET /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def" status: 200 len: 1569 microversion: 2.1 time: 0.157455 Jun 07 14:56:20.199964 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 625/1260] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:56:20 2022] GET /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:56:21.216429 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-8fb4c8d5-8068-4b6f-bd2d-10730ce15f99 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:56:21.217012 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-8fb4c8d5-8068-4b6f-bd2d-10730ce15f99 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] [instance: f56554dc-d349-4e0b-95b9-e86891387def] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:56:21.223500 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-8fb4c8d5-8068-4b6f-bd2d-10730ce15f99 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:56:21.223953 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-8fb4c8d5-8068-4b6f-bd2d-10730ce15f99 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:56:21.225250 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-8fb4c8d5-8068-4b6f-bd2d-10730ce15f99 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:56:21.225691 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-8fb4c8d5-8068-4b6f-bd2d-10730ce15f99 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:56:21.354380 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-8fb4c8d5-8068-4b6f-bd2d-10730ce15f99 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7e40e0dfbf49a58d67b897f4792399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deac7502c4684bdcb5dd9151d6c09894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:56:21.361856 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-8fb4c8d5-8068-4b6f-bd2d-10730ce15f99 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] 10.222.0.85 "GET /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def" status: 200 len: 1569 microversion: 2.1 time: 0.149427 Jun 07 14:56:21.362413 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 636/1261] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:56:21 2022] GET /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:56:22.379154 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-9b225779-e4fe-45e6-bf6e-7f3532bceee5 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:56:22.379793 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-9b225779-e4fe-45e6-bf6e-7f3532bceee5 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] [instance: f56554dc-d349-4e0b-95b9-e86891387def] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:56:22.386543 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-9b225779-e4fe-45e6-bf6e-7f3532bceee5 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:56:22.386998 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-9b225779-e4fe-45e6-bf6e-7f3532bceee5 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:56:22.387778 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-9b225779-e4fe-45e6-bf6e-7f3532bceee5 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:56:22.388217 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-9b225779-e4fe-45e6-bf6e-7f3532bceee5 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:56:22.516992 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-9b225779-e4fe-45e6-bf6e-7f3532bceee5 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7e40e0dfbf49a58d67b897f4792399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deac7502c4684bdcb5dd9151d6c09894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:56:22.525044 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-9b225779-e4fe-45e6-bf6e-7f3532bceee5 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] 10.222.0.85 "GET /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def" status: 200 len: 1569 microversion: 2.1 time: 0.149742 Jun 07 14:56:22.525614 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 626/1262] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:56:22 2022] GET /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:56:23.543315 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-eb7ef581-9319-4b2a-a6a3-c0d796ed5bf1 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:56:23.543927 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-eb7ef581-9319-4b2a-a6a3-c0d796ed5bf1 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] [instance: f56554dc-d349-4e0b-95b9-e86891387def] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:56:23.550323 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-eb7ef581-9319-4b2a-a6a3-c0d796ed5bf1 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:56:23.550769 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-eb7ef581-9319-4b2a-a6a3-c0d796ed5bf1 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:56:23.551532 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-eb7ef581-9319-4b2a-a6a3-c0d796ed5bf1 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:56:23.551960 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-eb7ef581-9319-4b2a-a6a3-c0d796ed5bf1 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:56:23.682588 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-eb7ef581-9319-4b2a-a6a3-c0d796ed5bf1 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7e40e0dfbf49a58d67b897f4792399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deac7502c4684bdcb5dd9151d6c09894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:56:23.690058 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-eb7ef581-9319-4b2a-a6a3-c0d796ed5bf1 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] 10.222.0.85 "GET /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def" status: 200 len: 1569 microversion: 2.1 time: 0.150759 Jun 07 14:56:23.690616 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 637/1263] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:56:23 2022] GET /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:56:24.712803 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-fa4bf282-cb35-4ec0-80f8-c86a1c1266b8 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:56:24.713421 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-fa4bf282-cb35-4ec0-80f8-c86a1c1266b8 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] [instance: f56554dc-d349-4e0b-95b9-e86891387def] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:56:24.720031 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-fa4bf282-cb35-4ec0-80f8-c86a1c1266b8 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:56:24.720513 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-fa4bf282-cb35-4ec0-80f8-c86a1c1266b8 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:56:24.721291 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-fa4bf282-cb35-4ec0-80f8-c86a1c1266b8 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:56:24.721751 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-fa4bf282-cb35-4ec0-80f8-c86a1c1266b8 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:56:24.857870 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-fa4bf282-cb35-4ec0-80f8-c86a1c1266b8 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7e40e0dfbf49a58d67b897f4792399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deac7502c4684bdcb5dd9151d6c09894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:56:24.869187 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-fa4bf282-cb35-4ec0-80f8-c86a1c1266b8 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] 10.222.0.85 "GET /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def" status: 200 len: 1569 microversion: 2.1 time: 0.158026 Jun 07 14:56:24.869187 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 627/1264] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:56:24 2022] GET /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:56:25.885763 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-430b41c5-4bb8-4f80-9f66-d211aa195e05 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:56:25.886366 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-430b41c5-4bb8-4f80-9f66-d211aa195e05 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] [instance: f56554dc-d349-4e0b-95b9-e86891387def] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:56:25.892913 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-430b41c5-4bb8-4f80-9f66-d211aa195e05 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:56:25.893360 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-430b41c5-4bb8-4f80-9f66-d211aa195e05 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:56:25.894130 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-430b41c5-4bb8-4f80-9f66-d211aa195e05 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:56:25.894562 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-430b41c5-4bb8-4f80-9f66-d211aa195e05 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:56:26.034996 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-430b41c5-4bb8-4f80-9f66-d211aa195e05 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7e40e0dfbf49a58d67b897f4792399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deac7502c4684bdcb5dd9151d6c09894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:56:26.042672 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-430b41c5-4bb8-4f80-9f66-d211aa195e05 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] 10.222.0.85 "GET /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def" status: 200 len: 1569 microversion: 2.1 time: 0.161270 Jun 07 14:56:26.043237 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 638/1265] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:56:25 2022] GET /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:56:27.060177 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-0e15c823-b133-42ec-bc55-4fa01e18bf14 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:56:27.060826 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-0e15c823-b133-42ec-bc55-4fa01e18bf14 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] [instance: f56554dc-d349-4e0b-95b9-e86891387def] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:56:27.067307 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-0e15c823-b133-42ec-bc55-4fa01e18bf14 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:56:27.067757 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-0e15c823-b133-42ec-bc55-4fa01e18bf14 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:56:27.068559 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-0e15c823-b133-42ec-bc55-4fa01e18bf14 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:56:27.069611 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-0e15c823-b133-42ec-bc55-4fa01e18bf14 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:56:27.208576 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-0e15c823-b133-42ec-bc55-4fa01e18bf14 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7e40e0dfbf49a58d67b897f4792399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deac7502c4684bdcb5dd9151d6c09894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:56:27.216555 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-0e15c823-b133-42ec-bc55-4fa01e18bf14 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] 10.222.0.85 "GET /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def" status: 200 len: 1569 microversion: 2.1 time: 0.160176 Jun 07 14:56:27.217370 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 628/1266] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:56:27 2022] GET /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:56:28.234682 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-14b8f33e-7611-4335-aac6-6e7eee6d3040 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:56:28.235294 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-14b8f33e-7611-4335-aac6-6e7eee6d3040 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] [instance: f56554dc-d349-4e0b-95b9-e86891387def] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:56:28.241935 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-14b8f33e-7611-4335-aac6-6e7eee6d3040 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:56:28.242391 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-14b8f33e-7611-4335-aac6-6e7eee6d3040 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:56:28.243153 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-14b8f33e-7611-4335-aac6-6e7eee6d3040 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:56:28.243577 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-14b8f33e-7611-4335-aac6-6e7eee6d3040 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:56:28.416766 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-14b8f33e-7611-4335-aac6-6e7eee6d3040 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7e40e0dfbf49a58d67b897f4792399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deac7502c4684bdcb5dd9151d6c09894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:56:28.424268 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-14b8f33e-7611-4335-aac6-6e7eee6d3040 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] 10.222.0.85 "GET /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def" status: 200 len: 1569 microversion: 2.1 time: 0.193509 Jun 07 14:56:28.430807 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 639/1267] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:56:28 2022] GET /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def => generated 1569 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:56:29.441336 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-0cd1f9f4-d9c9-42c9-a005-1e6c7ad762d2 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:56:29.441945 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-0cd1f9f4-d9c9-42c9-a005-1e6c7ad762d2 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] [instance: f56554dc-d349-4e0b-95b9-e86891387def] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:56:29.449267 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-0cd1f9f4-d9c9-42c9-a005-1e6c7ad762d2 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:56:29.449724 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-0cd1f9f4-d9c9-42c9-a005-1e6c7ad762d2 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:56:29.450499 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-0cd1f9f4-d9c9-42c9-a005-1e6c7ad762d2 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:56:29.450942 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-0cd1f9f4-d9c9-42c9-a005-1e6c7ad762d2 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:56:29.579377 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-0cd1f9f4-d9c9-42c9-a005-1e6c7ad762d2 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7e40e0dfbf49a58d67b897f4792399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deac7502c4684bdcb5dd9151d6c09894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:56:29.587438 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-0cd1f9f4-d9c9-42c9-a005-1e6c7ad762d2 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] 10.222.0.85 "GET /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def" status: 200 len: 1569 microversion: 2.1 time: 0.149890 Jun 07 14:56:29.587990 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 629/1268] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:56:29 2022] GET /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:56:30.605737 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-089b929d-11aa-46a8-9eb7-e351e08e7184 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:56:30.606359 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-089b929d-11aa-46a8-9eb7-e351e08e7184 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] [instance: f56554dc-d349-4e0b-95b9-e86891387def] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:56:30.612980 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-089b929d-11aa-46a8-9eb7-e351e08e7184 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:56:30.613433 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-089b929d-11aa-46a8-9eb7-e351e08e7184 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:56:30.614258 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-089b929d-11aa-46a8-9eb7-e351e08e7184 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:56:30.614743 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-089b929d-11aa-46a8-9eb7-e351e08e7184 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:56:30.755574 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-089b929d-11aa-46a8-9eb7-e351e08e7184 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7e40e0dfbf49a58d67b897f4792399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deac7502c4684bdcb5dd9151d6c09894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:56:30.768832 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-089b929d-11aa-46a8-9eb7-e351e08e7184 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] 10.222.0.85 "GET /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def" status: 200 len: 1569 microversion: 2.1 time: 0.167097 Jun 07 14:56:30.775303 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 640/1269] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:56:30 2022] GET /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def => generated 1569 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:56:31.787801 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-b5678cc9-e1de-4aa6-8ab7-feb7fa03615a tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:56:31.788788 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-b5678cc9-e1de-4aa6-8ab7-feb7fa03615a tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] [instance: f56554dc-d349-4e0b-95b9-e86891387def] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:56:31.795038 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-b5678cc9-e1de-4aa6-8ab7-feb7fa03615a tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:56:31.795487 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-b5678cc9-e1de-4aa6-8ab7-feb7fa03615a tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:56:31.796249 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-b5678cc9-e1de-4aa6-8ab7-feb7fa03615a tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:56:31.796709 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-b5678cc9-e1de-4aa6-8ab7-feb7fa03615a tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:56:31.926541 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-b5678cc9-e1de-4aa6-8ab7-feb7fa03615a tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7e40e0dfbf49a58d67b897f4792399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deac7502c4684bdcb5dd9151d6c09894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:56:31.933957 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-b5678cc9-e1de-4aa6-8ab7-feb7fa03615a tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] 10.222.0.85 "GET /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def" status: 200 len: 1510 microversion: 2.1 time: 0.150067 Jun 07 14:56:31.934515 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 630/1270] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:56:31 2022] GET /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def => generated 1510 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:56:31.950773 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-b42f73aa-ebf9-416e-876a-783162abf504 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:56:31.951342 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-b42f73aa-ebf9-416e-876a-783162abf504 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] [instance: f56554dc-d349-4e0b-95b9-e86891387def] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:56:31.957835 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-b42f73aa-ebf9-416e-876a-783162abf504 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:56:31.958582 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-b42f73aa-ebf9-416e-876a-783162abf504 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:56:31.959341 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-b42f73aa-ebf9-416e-876a-783162abf504 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:56:31.960336 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-b42f73aa-ebf9-416e-876a-783162abf504 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:56:32.247884 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-b42f73aa-ebf9-416e-876a-783162abf504 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] 10.222.0.85 "POST /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def/action" status: 202 len: 0 microversion: 2.1 time: 0.300858 Jun 07 14:56:32.248507 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 641/1271] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Jun 7 14:56:31 2022] POST /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def/action => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 14:56:32.257239 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-09ab8feb-7693-422b-aae9-b9cb0ce78379 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:56:32.257956 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-09ab8feb-7693-422b-aae9-b9cb0ce78379 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] [instance: f56554dc-d349-4e0b-95b9-e86891387def] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:56:32.263864 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-09ab8feb-7693-422b-aae9-b9cb0ce78379 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:56:32.264314 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-09ab8feb-7693-422b-aae9-b9cb0ce78379 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:56:32.265108 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-09ab8feb-7693-422b-aae9-b9cb0ce78379 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:56:32.265549 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-09ab8feb-7693-422b-aae9-b9cb0ce78379 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:56:32.396956 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-09ab8feb-7693-422b-aae9-b9cb0ce78379 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7e40e0dfbf49a58d67b897f4792399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deac7502c4684bdcb5dd9151d6c09894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:56:32.404358 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-09ab8feb-7693-422b-aae9-b9cb0ce78379 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] 10.222.0.85 "GET /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def" status: 200 len: 1518 microversion: 2.1 time: 0.151687 Jun 07 14:56:32.413031 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 631/1272] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:56:32 2022] GET /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def => generated 1518 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:56:33.422051 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-dd105410-97fc-4c83-8266-21ec53b0775c tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:56:33.422739 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-dd105410-97fc-4c83-8266-21ec53b0775c tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] [instance: f56554dc-d349-4e0b-95b9-e86891387def] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:56:33.431944 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-dd105410-97fc-4c83-8266-21ec53b0775c tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:56:33.431944 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-dd105410-97fc-4c83-8266-21ec53b0775c tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:56:33.431944 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-dd105410-97fc-4c83-8266-21ec53b0775c tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:56:33.431944 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-dd105410-97fc-4c83-8266-21ec53b0775c tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:56:33.470916 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [req-a8e1ea78-3b85-4bbb-96f9-b9c2165d3893 req-7e89bc72-d5ab-4ad3-9d75-23e68b99a87c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f56554dc-d349-4e0b-95b9-e86891387def", "name": "network-vif-unplugged", "status": "completed", "tag": "114b12fc-435d-466d-bf5f-18df5b6bc051"}]} {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:56:33.493547 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [req-a8e1ea78-3b85-4bbb-96f9-b9c2165d3893 req-7e89bc72-d5ab-4ad3-9d75-23e68b99a87c service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:56:33.494066 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [req-a8e1ea78-3b85-4bbb-96f9-b9c2165d3893 req-7e89bc72-d5ab-4ad3-9d75-23e68b99a87c service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:56:33.507809 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.compute.server_external_events [req-a8e1ea78-3b85-4bbb-96f9-b9c2165d3893 req-7e89bc72-d5ab-4ad3-9d75-23e68b99a87c service nova] Unable to find a host for instance f56554dc-d349-4e0b-95b9-e86891387def. Dropping event network-vif-unplugged {{(pid=118158) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 07 14:56:33.508758 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [req-a8e1ea78-3b85-4bbb-96f9-b9c2165d3893 req-7e89bc72-d5ab-4ad3-9d75-23e68b99a87c service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.105404 Jun 07 14:56:33.509335 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 642/1273] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jun 7 14:56:33 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 107 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 07 14:56:33.570771 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-dd105410-97fc-4c83-8266-21ec53b0775c tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7e40e0dfbf49a58d67b897f4792399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deac7502c4684bdcb5dd9151d6c09894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:56:33.578487 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-dd105410-97fc-4c83-8266-21ec53b0775c tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] 10.222.0.85 "GET /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def" status: 200 len: 1518 microversion: 2.1 time: 0.160145 Jun 07 14:56:33.579179 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 632/1274] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:56:33 2022] GET /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def => generated 1518 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 14:56:34.596683 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-29ff24f3-9e2e-4971-b0a7-2172cf393c83 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:56:34.597310 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-29ff24f3-9e2e-4971-b0a7-2172cf393c83 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] [instance: f56554dc-d349-4e0b-95b9-e86891387def] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:56:34.604385 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-29ff24f3-9e2e-4971-b0a7-2172cf393c83 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:56:34.608689 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-29ff24f3-9e2e-4971-b0a7-2172cf393c83 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:56:34.608689 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-29ff24f3-9e2e-4971-b0a7-2172cf393c83 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:56:34.608689 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-29ff24f3-9e2e-4971-b0a7-2172cf393c83 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:56:34.749267 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-29ff24f3-9e2e-4971-b0a7-2172cf393c83 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7e40e0dfbf49a58d67b897f4792399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deac7502c4684bdcb5dd9151d6c09894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:56:34.756993 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-29ff24f3-9e2e-4971-b0a7-2172cf393c83 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] 10.222.0.85 "GET /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def" status: 200 len: 1520 microversion: 2.1 time: 0.164263 Jun 07 14:56:34.763171 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 643/1275] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:56:34 2022] GET /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:56:35.775005 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-445ccb3a-256e-466d-9736-9df222a07120 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:56:35.781073 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-445ccb3a-256e-466d-9736-9df222a07120 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] [instance: f56554dc-d349-4e0b-95b9-e86891387def] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:56:35.782518 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-445ccb3a-256e-466d-9736-9df222a07120 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:56:35.782974 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-445ccb3a-256e-466d-9736-9df222a07120 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:56:35.783771 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-445ccb3a-256e-466d-9736-9df222a07120 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:56:35.784155 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-445ccb3a-256e-466d-9736-9df222a07120 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:56:35.916194 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-445ccb3a-256e-466d-9736-9df222a07120 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7e40e0dfbf49a58d67b897f4792399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deac7502c4684bdcb5dd9151d6c09894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:56:35.923709 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-445ccb3a-256e-466d-9736-9df222a07120 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] 10.222.0.85 "GET /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def" status: 200 len: 1576 microversion: 2.1 time: 0.153305 Jun 07 14:56:35.924262 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 633/1276] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:56:35 2022] GET /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:56:36.940823 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-66d8495a-7a6a-46e7-b2b0-a8fa833c1204 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:56:36.941432 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-66d8495a-7a6a-46e7-b2b0-a8fa833c1204 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] [instance: f56554dc-d349-4e0b-95b9-e86891387def] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:56:36.947952 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-66d8495a-7a6a-46e7-b2b0-a8fa833c1204 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:56:36.948426 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-66d8495a-7a6a-46e7-b2b0-a8fa833c1204 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:56:36.949202 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-66d8495a-7a6a-46e7-b2b0-a8fa833c1204 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:56:36.949640 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-66d8495a-7a6a-46e7-b2b0-a8fa833c1204 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:56:37.079507 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-66d8495a-7a6a-46e7-b2b0-a8fa833c1204 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7e40e0dfbf49a58d67b897f4792399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deac7502c4684bdcb5dd9151d6c09894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:56:37.086999 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-66d8495a-7a6a-46e7-b2b0-a8fa833c1204 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] 10.222.0.85 "GET /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def" status: 200 len: 1576 microversion: 2.1 time: 0.150060 Jun 07 14:56:37.087559 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 644/1277] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:56:36 2022] GET /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def => generated 1576 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:56:38.104873 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-e0898954-6b7b-4749-888e-5b29fb852f3a tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:56:38.105427 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-e0898954-6b7b-4749-888e-5b29fb852f3a tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] [instance: f56554dc-d349-4e0b-95b9-e86891387def] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:56:38.111838 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-e0898954-6b7b-4749-888e-5b29fb852f3a tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:56:38.112291 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-e0898954-6b7b-4749-888e-5b29fb852f3a tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:56:38.113088 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-e0898954-6b7b-4749-888e-5b29fb852f3a tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:56:38.113528 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-e0898954-6b7b-4749-888e-5b29fb852f3a tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:56:38.244215 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-e0898954-6b7b-4749-888e-5b29fb852f3a tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7e40e0dfbf49a58d67b897f4792399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deac7502c4684bdcb5dd9151d6c09894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:56:38.251776 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-e0898954-6b7b-4749-888e-5b29fb852f3a tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] 10.222.0.85 "GET /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def" status: 200 len: 1576 microversion: 2.1 time: 0.151494 Jun 07 14:56:38.252331 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 634/1278] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:56:38 2022] GET /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:56:39.268695 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-695fceee-60fb-409f-b6c1-6294c174a45a tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:56:39.269301 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-695fceee-60fb-409f-b6c1-6294c174a45a tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] [instance: f56554dc-d349-4e0b-95b9-e86891387def] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:56:39.275876 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-695fceee-60fb-409f-b6c1-6294c174a45a tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:56:39.276586 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-695fceee-60fb-409f-b6c1-6294c174a45a tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:56:39.277359 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-695fceee-60fb-409f-b6c1-6294c174a45a tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:56:39.277799 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-695fceee-60fb-409f-b6c1-6294c174a45a tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:56:39.415234 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-695fceee-60fb-409f-b6c1-6294c174a45a tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7e40e0dfbf49a58d67b897f4792399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deac7502c4684bdcb5dd9151d6c09894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:56:39.422849 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-695fceee-60fb-409f-b6c1-6294c174a45a tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] 10.222.0.85 "GET /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def" status: 200 len: 1576 microversion: 2.1 time: 0.158059 Jun 07 14:56:39.427331 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 645/1279] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:56:39 2022] GET /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:56:40.440741 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-c4c81e35-4672-4fce-9fef-c2f79cc1bdca tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:56:40.441311 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-c4c81e35-4672-4fce-9fef-c2f79cc1bdca tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] [instance: f56554dc-d349-4e0b-95b9-e86891387def] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:56:40.448621 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-c4c81e35-4672-4fce-9fef-c2f79cc1bdca tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:56:40.449072 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-c4c81e35-4672-4fce-9fef-c2f79cc1bdca tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:56:40.449842 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-c4c81e35-4672-4fce-9fef-c2f79cc1bdca tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:56:40.450279 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-c4c81e35-4672-4fce-9fef-c2f79cc1bdca tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:56:40.595343 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-c4c81e35-4672-4fce-9fef-c2f79cc1bdca tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7e40e0dfbf49a58d67b897f4792399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deac7502c4684bdcb5dd9151d6c09894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:56:40.603615 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-c4c81e35-4672-4fce-9fef-c2f79cc1bdca tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] 10.222.0.85 "GET /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def" status: 200 len: 1576 microversion: 2.1 time: 0.166793 Jun 07 14:56:40.604190 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 635/1280] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:56:40 2022] GET /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def => generated 1576 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:56:41.621342 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-ba07a256-a771-4dc0-b4f9-1966eb7f5ba7 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:56:41.621983 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-ba07a256-a771-4dc0-b4f9-1966eb7f5ba7 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] [instance: f56554dc-d349-4e0b-95b9-e86891387def] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:56:41.628354 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-ba07a256-a771-4dc0-b4f9-1966eb7f5ba7 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:56:41.628827 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-ba07a256-a771-4dc0-b4f9-1966eb7f5ba7 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:56:41.629584 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-ba07a256-a771-4dc0-b4f9-1966eb7f5ba7 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:56:41.630014 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-ba07a256-a771-4dc0-b4f9-1966eb7f5ba7 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:56:41.757660 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-ba07a256-a771-4dc0-b4f9-1966eb7f5ba7 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7e40e0dfbf49a58d67b897f4792399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deac7502c4684bdcb5dd9151d6c09894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:56:41.766026 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-ba07a256-a771-4dc0-b4f9-1966eb7f5ba7 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] 10.222.0.85 "GET /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def" status: 200 len: 1576 microversion: 2.1 time: 0.147584 Jun 07 14:56:41.766026 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 646/1281] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:56:41 2022] GET /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def => generated 1576 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:56:42.783188 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-7ec228e7-913c-4a2c-ab74-a76f40821bd4 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:56:42.783883 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-7ec228e7-913c-4a2c-ab74-a76f40821bd4 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] [instance: f56554dc-d349-4e0b-95b9-e86891387def] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:56:42.791336 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-7ec228e7-913c-4a2c-ab74-a76f40821bd4 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:56:42.791778 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-7ec228e7-913c-4a2c-ab74-a76f40821bd4 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:56:42.792698 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-7ec228e7-913c-4a2c-ab74-a76f40821bd4 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:56:42.793455 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-7ec228e7-913c-4a2c-ab74-a76f40821bd4 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:56:42.946064 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-7ec228e7-913c-4a2c-ab74-a76f40821bd4 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7e40e0dfbf49a58d67b897f4792399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deac7502c4684bdcb5dd9151d6c09894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:56:42.954052 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-7ec228e7-913c-4a2c-ab74-a76f40821bd4 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] 10.222.0.85 "GET /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def" status: 200 len: 1576 microversion: 2.1 time: 0.175078 Jun 07 14:56:42.954614 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 636/1282] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:56:42 2022] GET /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def => generated 1576 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:56:43.972216 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-32bae1b0-f321-4372-b647-ef1e993b463f tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:56:43.972860 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-32bae1b0-f321-4372-b647-ef1e993b463f tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] [instance: f56554dc-d349-4e0b-95b9-e86891387def] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:56:43.980057 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-32bae1b0-f321-4372-b647-ef1e993b463f tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:56:43.980556 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-32bae1b0-f321-4372-b647-ef1e993b463f tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:56:43.981321 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-32bae1b0-f321-4372-b647-ef1e993b463f tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:56:43.981760 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-32bae1b0-f321-4372-b647-ef1e993b463f tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:56:44.113869 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-32bae1b0-f321-4372-b647-ef1e993b463f tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7e40e0dfbf49a58d67b897f4792399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deac7502c4684bdcb5dd9151d6c09894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:56:44.121909 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-32bae1b0-f321-4372-b647-ef1e993b463f tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] 10.222.0.85 "GET /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def" status: 200 len: 1576 microversion: 2.1 time: 0.153568 Jun 07 14:56:44.122473 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 647/1283] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:56:43 2022] GET /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:56:45.139365 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-7488a37d-2248-4ee0-921e-801fc46d3558 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:56:45.139994 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-7488a37d-2248-4ee0-921e-801fc46d3558 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] [instance: f56554dc-d349-4e0b-95b9-e86891387def] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:56:45.146474 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-7488a37d-2248-4ee0-921e-801fc46d3558 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:56:45.151087 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-7488a37d-2248-4ee0-921e-801fc46d3558 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:56:45.151087 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-7488a37d-2248-4ee0-921e-801fc46d3558 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:56:45.151087 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-7488a37d-2248-4ee0-921e-801fc46d3558 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:56:45.277030 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-7488a37d-2248-4ee0-921e-801fc46d3558 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7e40e0dfbf49a58d67b897f4792399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deac7502c4684bdcb5dd9151d6c09894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:56:45.284817 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-7488a37d-2248-4ee0-921e-801fc46d3558 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] 10.222.0.85 "GET /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def" status: 200 len: 1576 microversion: 2.1 time: 0.149251 Jun 07 14:56:45.285377 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 637/1284] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:56:45 2022] GET /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def => generated 1576 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:56:46.301310 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-e1229606-8886-4df8-b0c1-bc7ae0368e32 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:56:46.301946 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-e1229606-8886-4df8-b0c1-bc7ae0368e32 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] [instance: f56554dc-d349-4e0b-95b9-e86891387def] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:56:46.309167 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-e1229606-8886-4df8-b0c1-bc7ae0368e32 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:56:46.309607 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-e1229606-8886-4df8-b0c1-bc7ae0368e32 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:56:46.310363 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-e1229606-8886-4df8-b0c1-bc7ae0368e32 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:56:46.310785 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-e1229606-8886-4df8-b0c1-bc7ae0368e32 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:56:46.314709 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG dbcounter [-] [118158] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:56:46.443181 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-e1229606-8886-4df8-b0c1-bc7ae0368e32 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7e40e0dfbf49a58d67b897f4792399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deac7502c4684bdcb5dd9151d6c09894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:56:46.451342 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-e1229606-8886-4df8-b0c1-bc7ae0368e32 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] 10.222.0.85 "GET /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def" status: 200 len: 1576 microversion: 2.1 time: 0.153856 Jun 07 14:56:46.451904 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 648/1285] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:56:46 2022] GET /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:56:47.189115 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 14:56:47.189664 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Tue Jun 7 14:56:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 07 14:56:47.468551 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-aa67c0d0-c551-4f62-a98e-cbd327949b81 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:56:47.469178 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-aa67c0d0-c551-4f62-a98e-cbd327949b81 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] [instance: f56554dc-d349-4e0b-95b9-e86891387def] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:56:47.475697 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-aa67c0d0-c551-4f62-a98e-cbd327949b81 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:56:47.476337 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-aa67c0d0-c551-4f62-a98e-cbd327949b81 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:56:47.477267 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-aa67c0d0-c551-4f62-a98e-cbd327949b81 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:56:47.477714 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-aa67c0d0-c551-4f62-a98e-cbd327949b81 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:56:47.504285 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [req-84047209-75c6-4894-a1da-03fe18cf4186 req-ae254022-b459-450e-b2bb-4caf8a12c126 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f56554dc-d349-4e0b-95b9-e86891387def", "name": "network-vif-plugged", "status": "completed", "tag": "114b12fc-435d-466d-bf5f-18df5b6bc051"}]} {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:56:47.510816 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG dbcounter [-] [118158] Writing DB stats nova_api:SELECT=33 {{(pid=118158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:56:47.516040 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [req-84047209-75c6-4894-a1da-03fe18cf4186 req-ae254022-b459-450e-b2bb-4caf8a12c126 service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:56:47.516515 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [req-84047209-75c6-4894-a1da-03fe18cf4186 req-ae254022-b459-450e-b2bb-4caf8a12c126 service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:56:47.528067 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.compute.server_external_events [req-84047209-75c6-4894-a1da-03fe18cf4186 req-ae254022-b459-450e-b2bb-4caf8a12c126 service nova] Creating event network-vif-plugged:114b12fc-435d-466d-bf5f-18df5b6bc051 for instance f56554dc-d349-4e0b-95b9-e86891387def on hv-cinder-84497 Jun 07 14:56:47.533353 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [req-84047209-75c6-4894-a1da-03fe18cf4186 req-ae254022-b459-450e-b2bb-4caf8a12c126 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032830 Jun 07 14:56:47.534053 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 649/1286] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jun 7 14:56:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 14:56:47.618424 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-aa67c0d0-c551-4f62-a98e-cbd327949b81 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7e40e0dfbf49a58d67b897f4792399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deac7502c4684bdcb5dd9151d6c09894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:56:47.625900 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-aa67c0d0-c551-4f62-a98e-cbd327949b81 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] 10.222.0.85 "GET /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def" status: 200 len: 1576 microversion: 2.1 time: 0.161273 Jun 07 14:56:47.626450 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 638/1287] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:56:47 2022] GET /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:56:48.644467 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-88e9b1f4-0d0b-4a97-ba5e-e1ecf84927c0 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:56:48.645217 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-88e9b1f4-0d0b-4a97-ba5e-e1ecf84927c0 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] [instance: f56554dc-d349-4e0b-95b9-e86891387def] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:56:48.651908 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-88e9b1f4-0d0b-4a97-ba5e-e1ecf84927c0 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:56:48.652364 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-88e9b1f4-0d0b-4a97-ba5e-e1ecf84927c0 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:56:48.653143 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-88e9b1f4-0d0b-4a97-ba5e-e1ecf84927c0 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:56:48.653630 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-88e9b1f4-0d0b-4a97-ba5e-e1ecf84927c0 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:56:48.788985 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-88e9b1f4-0d0b-4a97-ba5e-e1ecf84927c0 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7e40e0dfbf49a58d67b897f4792399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deac7502c4684bdcb5dd9151d6c09894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:56:48.796546 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-88e9b1f4-0d0b-4a97-ba5e-e1ecf84927c0 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] 10.222.0.85 "GET /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def" status: 200 len: 1576 microversion: 2.1 time: 0.157207 Jun 07 14:56:48.797102 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 650/1288] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:56:48 2022] GET /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:56:49.813141 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-f2d25bc4-b65e-43c9-b560-49b71bf038d4 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:56:49.813750 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-f2d25bc4-b65e-43c9-b560-49b71bf038d4 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] [instance: f56554dc-d349-4e0b-95b9-e86891387def] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:56:49.816071 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG dbcounter [-] [118157] Writing DB stats nova_api:SELECT=31 {{(pid=118157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:56:49.821579 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-f2d25bc4-b65e-43c9-b560-49b71bf038d4 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:56:49.822033 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-f2d25bc4-b65e-43c9-b560-49b71bf038d4 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:56:49.822801 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-f2d25bc4-b65e-43c9-b560-49b71bf038d4 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:56:49.823239 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-f2d25bc4-b65e-43c9-b560-49b71bf038d4 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:56:49.826100 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG dbcounter [-] [118157] Writing DB stats nova_cell1:SELECT=91 {{(pid=118157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:56:49.953559 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-f2d25bc4-b65e-43c9-b560-49b71bf038d4 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7e40e0dfbf49a58d67b897f4792399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deac7502c4684bdcb5dd9151d6c09894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:56:49.962161 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-f2d25bc4-b65e-43c9-b560-49b71bf038d4 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] 10.222.0.85 "GET /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def" status: 200 len: 1563 microversion: 2.1 time: 0.153084 Jun 07 14:56:49.962721 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 639/1289] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:56:49 2022] GET /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def => generated 1563 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:58:17.915217 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-54c2d34c-b7f2-4c4f-8a3e-576591ba8478 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:58:17.915766 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-54c2d34c-b7f2-4c4f-8a3e-576591ba8478 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] [instance: f56554dc-d349-4e0b-95b9-e86891387def] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:58:17.917307 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [req-e0abde45-74e5-4282-9519-ca4f7288b0a5 req-db829d09-c0f4-4d99-b028-d8fba29ae66e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f56554dc-d349-4e0b-95b9-e86891387def", "tag": "114b12fc-435d-466d-bf5f-18df5b6bc051"}]} {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:58:17.918031 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG dbcounter [-] [118158] Writing DB stats nova_api:SELECT=3 {{(pid=118158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:58:17.918916 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG dbcounter [-] [118158] Writing DB stats nova_cell1:SELECT=12 {{(pid=118158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:58:17.921842 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG dbcounter [-] [118157] Writing DB stats nova_api:SELECT=1 {{(pid=118157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:58:17.923125 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG dbcounter [-] [118157] Writing DB stats nova_cell1:SELECT=5 {{(pid=118157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:58:17.924735 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-54c2d34c-b7f2-4c4f-8a3e-576591ba8478 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:58:17.929272 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-54c2d34c-b7f2-4c4f-8a3e-576591ba8478 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:58:17.929272 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-54c2d34c-b7f2-4c4f-8a3e-576591ba8478 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:58:17.929272 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-54c2d34c-b7f2-4c4f-8a3e-576591ba8478 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:58:17.929587 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [req-e0abde45-74e5-4282-9519-ca4f7288b0a5 req-db829d09-c0f4-4d99-b028-d8fba29ae66e service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:58:17.929587 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [req-e0abde45-74e5-4282-9519-ca4f7288b0a5 req-db829d09-c0f4-4d99-b028-d8fba29ae66e service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:58:17.945055 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.compute.server_external_events [req-e0abde45-74e5-4282-9519-ca4f7288b0a5 req-db829d09-c0f4-4d99-b028-d8fba29ae66e service nova] Creating event network-changed:114b12fc-435d-466d-bf5f-18df5b6bc051 for instance f56554dc-d349-4e0b-95b9-e86891387def on hv-cinder-84497 Jun 07 14:58:17.950512 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [req-e0abde45-74e5-4282-9519-ca4f7288b0a5 req-db829d09-c0f4-4d99-b028-d8fba29ae66e service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037296 Jun 07 14:58:17.956031 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 640/1290] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jun 7 14:58:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:58:17.957345 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-54c2d34c-b7f2-4c4f-8a3e-576591ba8478 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] [instance: f56554dc-d349-4e0b-95b9-e86891387def] Going to try to terminate instance {{(pid=118158) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 14:58:18.175667 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-54c2d34c-b7f2-4c4f-8a3e-576591ba8478 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] 10.222.0.85 "DELETE /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def" status: 204 len: 0 microversion: 2.1 time: 0.265251 Jun 07 14:58:18.176595 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 651/1291] 10.222.0.85 () {58 vars in 1238 bytes} [Tue Jun 7 14:58:17 2022] DELETE /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def => generated 0 bytes in 267 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 14:58:18.186165 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-9630802d-e6ce-4c06-89bd-a85b77596c3b tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:58:18.187030 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-9630802d-e6ce-4c06-89bd-a85b77596c3b tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] [instance: f56554dc-d349-4e0b-95b9-e86891387def] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:58:18.195238 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-9630802d-e6ce-4c06-89bd-a85b77596c3b tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:58:18.197313 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-9630802d-e6ce-4c06-89bd-a85b77596c3b tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:58:18.198559 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-9630802d-e6ce-4c06-89bd-a85b77596c3b tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:58:18.198559 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-9630802d-e6ce-4c06-89bd-a85b77596c3b tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:58:18.338222 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-9630802d-e6ce-4c06-89bd-a85b77596c3b tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7e40e0dfbf49a58d67b897f4792399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deac7502c4684bdcb5dd9151d6c09894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:58:18.346083 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-9630802d-e6ce-4c06-89bd-a85b77596c3b tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] 10.222.0.85 "GET /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def" status: 200 len: 1569 microversion: 2.1 time: 0.165120 Jun 07 14:58:18.346649 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 641/1292] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:58:18 2022] GET /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:58:19.365005 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-37c86c40-5aff-4e2e-8ce6-22c1449a4491 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:58:19.365744 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-37c86c40-5aff-4e2e-8ce6-22c1449a4491 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] [instance: f56554dc-d349-4e0b-95b9-e86891387def] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:58:19.371809 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-37c86c40-5aff-4e2e-8ce6-22c1449a4491 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:58:19.372260 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-37c86c40-5aff-4e2e-8ce6-22c1449a4491 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:58:19.373060 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-37c86c40-5aff-4e2e-8ce6-22c1449a4491 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:58:19.373495 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-37c86c40-5aff-4e2e-8ce6-22c1449a4491 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:58:19.573853 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.policy [None req-37c86c40-5aff-4e2e-8ce6-22c1449a4491 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7e40e0dfbf49a58d67b897f4792399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deac7502c4684bdcb5dd9151d6c09894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118158) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:58:19.581940 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-37c86c40-5aff-4e2e-8ce6-22c1449a4491 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] 10.222.0.85 "GET /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def" status: 200 len: 1569 microversion: 2.1 time: 0.221325 Jun 07 14:58:19.582956 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 652/1293] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:58:19 2022] GET /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def => generated 1569 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:58:20.601488 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-d18da081-adba-46ce-9d06-9053e4981323 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:58:20.602148 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-d18da081-adba-46ce-9d06-9053e4981323 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] [instance: f56554dc-d349-4e0b-95b9-e86891387def] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:58:20.608135 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-d18da081-adba-46ce-9d06-9053e4981323 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:58:20.608621 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-d18da081-adba-46ce-9d06-9053e4981323 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:58:20.609389 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-d18da081-adba-46ce-9d06-9053e4981323 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:58:20.609823 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-d18da081-adba-46ce-9d06-9053e4981323 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:58:20.749529 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-d18da081-adba-46ce-9d06-9053e4981323 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7e40e0dfbf49a58d67b897f4792399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deac7502c4684bdcb5dd9151d6c09894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:58:20.755890 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-d18da081-adba-46ce-9d06-9053e4981323 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] 10.222.0.85 "GET /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def" status: 200 len: 1450 microversion: 2.1 time: 0.158520 Jun 07 14:58:20.756883 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 642/1294] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:58:20 2022] GET /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def => generated 1450 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:58:20.901230 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [req-251a2dab-a7db-46b1-9cd8-31f5d710be79 req-ba6f9fd7-eb45-47e4-bb0e-6f849e3c2301 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f56554dc-d349-4e0b-95b9-e86891387def", "name": "network-vif-deleted", "tag": "114b12fc-435d-466d-bf5f-18df5b6bc051"}]} {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 14:58:20.910191 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [req-251a2dab-a7db-46b1-9cd8-31f5d710be79 req-ba6f9fd7-eb45-47e4-bb0e-6f849e3c2301 service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:58:20.910631 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [req-251a2dab-a7db-46b1-9cd8-31f5d710be79 req-ba6f9fd7-eb45-47e4-bb0e-6f849e3c2301 service nova] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:58:20.921874 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.compute.server_external_events [req-251a2dab-a7db-46b1-9cd8-31f5d710be79 req-ba6f9fd7-eb45-47e4-bb0e-6f849e3c2301 service nova] Creating event network-vif-deleted:114b12fc-435d-466d-bf5f-18df5b6bc051 for instance f56554dc-d349-4e0b-95b9-e86891387def on hv-cinder-84497 Jun 07 14:58:20.927507 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [req-251a2dab-a7db-46b1-9cd8-31f5d710be79 req-ba6f9fd7-eb45-47e4-bb0e-6f849e3c2301 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091256 Jun 07 14:58:20.928089 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 653/1295] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jun 7 14:58:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 14:58:21.774851 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-c107e48b-08e2-4a2c-abda-70d63276b014 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Calling method '>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:58:21.775669 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.compute.api [None req-c107e48b-08e2-4a2c-abda-70d63276b014 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] [instance: f56554dc-d349-4e0b-95b9-e86891387def] Fetching instance by UUID {{(pid=118157) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:58:21.782964 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-c107e48b-08e2-4a2c-abda-70d63276b014 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:58:21.783441 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-c107e48b-08e2-4a2c-abda-70d63276b014 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:58:21.784224 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-c107e48b-08e2-4a2c-abda-70d63276b014 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:58:21.784690 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-c107e48b-08e2-4a2c-abda-70d63276b014 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:58:21.822460 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-c107e48b-08e2-4a2c-abda-70d63276b014 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:58:21.822915 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG oslo_concurrency.lockutils [None req-c107e48b-08e2-4a2c-abda-70d63276b014 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:58:21.823413 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.objects.instance [None req-c107e48b-08e2-4a2c-abda-70d63276b014 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lazy-loading 'fault' on Instance uuid f56554dc-d349-4e0b-95b9-e86891387def {{(pid=118157) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 14:58:21.864794 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.policy [None req-c107e48b-08e2-4a2c-abda-70d63276b014 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7e40e0dfbf49a58d67b897f4792399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deac7502c4684bdcb5dd9151d6c09894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118157) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 14:58:21.872733 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-c107e48b-08e2-4a2c-abda-70d63276b014 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] 10.222.0.85 "GET /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def" status: 200 len: 1224 microversion: 2.1 time: 0.102446 Jun 07 14:58:21.873310 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 643/1296] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:58:21 2022] GET /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def => generated 1224 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 14:58:22.893928 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-0efd70bc-4c00-4aee-aa29-ed9024d1cb6b tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Calling method '>' {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:58:22.894634 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.compute.api [None req-0efd70bc-4c00-4aee-aa29-ed9024d1cb6b tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] [instance: f56554dc-d349-4e0b-95b9-e86891387def] Fetching instance by UUID {{(pid=118158) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 14:58:22.901135 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-0efd70bc-4c00-4aee-aa29-ed9024d1cb6b tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:58:22.901585 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-0efd70bc-4c00-4aee-aa29-ed9024d1cb6b tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:58:22.902356 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-0efd70bc-4c00-4aee-aa29-ed9024d1cb6b tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 14:58:22.902792 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG oslo_concurrency.lockutils [None req-0efd70bc-4c00-4aee-aa29-ed9024d1cb6b tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Lock "dc303ae0-773f-43ce-b623-3e851eed4eb7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 14:58:22.916784 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.wsgi [None req-0efd70bc-4c00-4aee-aa29-ed9024d1cb6b tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] HTTP exception thrown: Instance f56554dc-d349-4e0b-95b9-e86891387def could not be found. Jun 07 14:58:22.918406 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-0efd70bc-4c00-4aee-aa29-ed9024d1cb6b tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Request method failure captured: Jun 07 14:58:22.918406 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: request: GET /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def HTTP/1.1 Jun 07 14:58:22.918406 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Accept: application/json Jun 07 14:58:22.918406 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Accept-Encoding: identity Jun 07 14:58:22.918406 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Connection: close Jun 07 14:58:22.918406 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Content-Length: 0 Jun 07 14:58:22.918406 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Content-Type: application/json Jun 07 14:58:22.918406 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Host: 10.222.0.85 Jun 07 14:58:22.918406 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Openstack-System-Scope: None Jun 07 14:58:22.918406 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: User-Agent: python-urllib3/1.26.9 Jun 07 14:58:22.918406 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Auth-Token: gAAAAABin2ZN9V6B2na_3aH65WFiEhmYguiEFz_MP8V_zB0bmxeZtF87sRIb_gsssmFhCB-wC42ZO6oMYwZwzXlobs9vPRY8pibPeDlNvig4cI0i_m4pJKBzqJLa1oLDx6qbR3jThbt5bH7VJLjTm60vcrxdcMTGu52o2jqw8eye6qAVZPDQHqw Jun 07 14:58:22.918406 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Domain-Id: None Jun 07 14:58:22.918406 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Domain-Name: None Jun 07 14:58:22.918406 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Identity-Status: Confirmed Jun 07 14:58:22.918406 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Is-Admin-Project: True Jun 07 14:58:22.918406 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Domain-Id: default Jun 07 14:58:22.918406 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Domain-Name: Default Jun 07 14:58:22.918406 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Id: deac7502c4684bdcb5dd9151d6c09894 Jun 07 14:58:22.918406 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Project-Name: tempest-TestShelveInstance-1707724077 Jun 07 14:58:22.918406 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Role: member,reader Jun 07 14:58:22.918406 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Roles: member,reader Jun 07 14:58:22.920227 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/deac7502c4684bdcb5dd9151d6c09894"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_deac7502c4684bdcb5dd9151d6c09894"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/deac7502c4684bdcb5dd9151d6c09894"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/deac7502c4684bdcb5dd9151d6c09894"}]}] Jun 07 14:58:22.920227 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Tenant: tempest-TestShelveInstance-1707724077 Jun 07 14:58:22.920227 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Tenant-Id: deac7502c4684bdcb5dd9151d6c09894 Jun 07 14:58:22.920227 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-Tenant-Name: tempest-TestShelveInstance-1707724077 Jun 07 14:58:22.920227 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User: tempest-TestShelveInstance-1707724077-project Jun 07 14:58:22.920227 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Domain-Id: default Jun 07 14:58:22.920227 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Domain-Name: Default Jun 07 14:58:22.920227 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Id: 9e7e40e0dfbf49a58d67b897f4792399 Jun 07 14:58:22.920227 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: X-User-Name: tempest-TestShelveInstance-1707724077-project Jun 07 14:58:22.920227 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: method: > Jun 07 14:58:22.920227 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: exception: Instance f56554dc-d349-4e0b-95b9-e86891387def could not be found. Jun 07 14:58:22.920227 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: action_args: {'id': 'f56554dc-d349-4e0b-95b9-e86891387def'} Jun 07 14:58:22.921300 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: {{(pid=118158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 14:58:22.921300 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:58:22.921300 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 14:58:22.921300 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 14:58:22.921300 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 14:58:22.921300 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 14:58:22.921300 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 14:58:22.921300 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 14:58:22.921300 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 14:58:22.921300 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 14:58:22.921300 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f56554dc-d349-4e0b-95b9-e86891387def could not be found. Jun 07 14:58:22.921300 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:58:22.921300 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:58:22.921300 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:58:22.921300 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:58:22.921300 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:58:22.921300 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:58:22.921300 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 14:58:22.921300 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 14:58:22.921300 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 14:58:22.922991 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 14:58:22.922991 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 14:58:22.922991 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 14:58:22.922991 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 14:58:22.922991 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 14:58:22.922991 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 14:58:22.922991 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 14:58:22.922991 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f56554dc-d349-4e0b-95b9-e86891387def could not be found. Jun 07 14:58:22.922991 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:58:22.922991 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 14:58:22.922991 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:58:22.922991 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 14:58:22.922991 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 14:58:22.922991 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 14:58:22.922991 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 14:58:22.922991 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 14:58:22.922991 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f56554dc-d349-4e0b-95b9-e86891387def could not be found. Jun 07 14:58:22.922991 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: ERROR nova.api.openstack.wsgi Jun 07 14:58:22.925109 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: DEBUG nova.api.openstack.wsgi [None req-0efd70bc-4c00-4aee-aa29-ed9024d1cb6b tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Returning 404 to user: Instance f56554dc-d349-4e0b-95b9-e86891387def could not be found. {{(pid=118158) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 14:58:22.925109 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO nova.api.openstack.requestlog [None req-0efd70bc-4c00-4aee-aa29-ed9024d1cb6b tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] 10.222.0.85 "GET /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def" status: 404 len: 111 microversion: 2.1 time: 0.032343 Jun 07 14:58:22.925109 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: [pid: 118158|app: 0|req: 654/1297] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jun 7 14:58:22 2022] GET /compute/v2.1/servers/f56554dc-d349-4e0b-95b9-e86891387def => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 14:58:23.139650 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: DEBUG nova.api.openstack.wsgi [None req-ab684c9f-652b-4e28-b67c-6e943ef35620 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] Calling method '.version_select at 0x7f5f8825a8b0>' {{(pid=118157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 14:58:23.227081 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO nova.api.openstack.requestlog [None req-ab684c9f-652b-4e28-b67c-6e943ef35620 tempest-TestShelveInstance-1707724077 tempest-TestShelveInstance-1707724077-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-492376855" status: 202 len: 0 microversion: 2.1 time: 0.091287 Jun 07 14:58:23.227656 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: [pid: 118157|app: 0|req: 644/1298] 10.222.0.85 () {58 vars in 1250 bytes} [Tue Jun 7 14:58:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-492376855 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 14:59:17.666731 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 14:59:17.667550 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Tue Jun 7 14:59:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 07 14:59:27.103725 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 14:59:27.104329 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Tue Jun 7 14:59:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 07 14:59:40.058946 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 14:59:40.059512 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Tue Jun 7 14:59:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 07 15:01:17.788262 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 15:01:17.788950 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Tue Jun 7 15:01:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 07 15:01:28.975817 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 15:01:28.976430 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Tue Jun 7 15:01:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 07 15:02:37.675883 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 15:02:37.676556 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Tue Jun 7 15:02:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 07 15:02:47.112797 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 15:02:47.113572 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Tue Jun 7 15:02:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 07 15:03:00.067269 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 15:03:00.067871 dv-cinder-844974-1-iscsi devstack@n-api.service[118158]: Tue Jun 7 15:03:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 07 15:03:27.201182 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 15:03:27.201791 dv-cinder-844974-1-iscsi devstack@n-api.service[118157]: Tue Jun 7 15:03:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!